[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:17:24 dist-test-slave-t7g5 krb5kdc[30870](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:17:24 dist-test-slave-t7g5 krb5kdc[30870](info): set up 2 sockets
Aug 07 20:17:24 dist-test-slave-t7g5 krb5kdc[30870](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 20:17:25.325474 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.121s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:17:25 dist-test-slave-t7g5 krb5kdc[30870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:17:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:17:25.442224 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:37735
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:44875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:37735
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:25.524348 30888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:25.524567 30888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:25.524590 30888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:25.525739 30888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:25.525785 30888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:25.525800 30888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:25.525815 30888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:25.525833 30888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:25.527281 30888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:44875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:37735
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:37735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:25.527478 30888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:25.527657 30888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:25.532572 30900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:25.532593 30903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:25.532786 30888 server_base.cc:1034] running on GCE node
W20260807 20:17:25.532596 30901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:25.533109 30888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:25.533377 30888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:25.534520 30888 hybrid_clock.cc:648] HybridClock initialized: now 1786133845534501 us; error 34 us; skew 500 ppm
Aug 07 20:17:25 dist-test-slave-t7g5 krb5kdc[30870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133845, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:25.536954 30888 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:17:25.537341 30888 webserver.cc:460] Webserver started at http://127.30.35.254:41039/ using document root <none> and password file <none>
I20260807 20:17:25.537528 30888 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:25.537569 30888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:25.537714 30888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:25.538846 30888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "e92d288e8037488bb3be93812f71a71b"
format_stamp: "Formatted at 2026-08-07 20:17:25 on dist-test-slave-t7g5"
server_key: "f580a4a56ecc139bee4d1b6b22bef935"
server_key_iv: "53b557162252954ab69eefcb9e464f9e"
server_key_version: "encryptionkey@0"
I20260807 20:17:25.539189 30888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "e92d288e8037488bb3be93812f71a71b"
format_stamp: "Formatted at 2026-08-07 20:17:25 on dist-test-slave-t7g5"
server_key: "f580a4a56ecc139bee4d1b6b22bef935"
server_key_iv: "53b557162252954ab69eefcb9e464f9e"
server_key_version: "encryptionkey@0"
I20260807 20:17:25.540462 30888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:17:25.541179 30913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:25.541321 30888 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:25.541407 30888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "e92d288e8037488bb3be93812f71a71b"
format_stamp: "Formatted at 2026-08-07 20:17:25 on dist-test-slave-t7g5"
server_key: "f580a4a56ecc139bee4d1b6b22bef935"
server_key_iv: "53b557162252954ab69eefcb9e464f9e"
server_key_version: "encryptionkey@0"
I20260807 20:17:25.541465 30888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:25.564884 30888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:25.566624 30888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:25.566756 30888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:25.570559 30888 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:37735
I20260807 20:17:25.570597 31007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:37735 every 8 connection(s)
I20260807 20:17:25.570923 30888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:25.571754 31008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:25.574106 31008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b: Bootstrap starting.
I20260807 20:17:25.574625 31008 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:25.574863 31008 log.cc:824] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:25.575496 31008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b: No bootstrap required, opened a new log
I20260807 20:17:25.576746 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 30888
I20260807 20:17:25.576831 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:25.577067 31008 raft_consensus.cc:348] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e92d288e8037488bb3be93812f71a71b" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37735 } }
I20260807 20:17:25.577200 31008 raft_consensus.cc:374] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:25.577221 31008 raft_consensus.cc:729] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92d288e8037488bb3be93812f71a71b, State: Initialized, Role: FOLLOWER
I20260807 20:17:25.577363 31008 consensus_queue.cc:260] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e92d288e8037488bb3be93812f71a71b" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37735 } }
I20260807 20:17:25.577443 31008 raft_consensus.cc:388] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:25.577467 31008 raft_consensus.cc:482] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:25.577476 30863 external_mini_cluster.cc:1428] Setting key dfaa8e8f44e639b1c46731410894d31f
I20260807 20:17:25.577515 31008 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:25.578092 31008 raft_consensus.cc:504] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e92d288e8037488bb3be93812f71a71b" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37735 } }
I20260807 20:17:25.578207 31008 leader_election.cc:302] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e92d288e8037488bb3be93812f71a71b; no voters:
I20260807 20:17:25.578384 31008 leader_election.cc:288] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:25.578583 31015 sys_catalog.cc:455] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e92d288e8037488bb3be93812f71a71b" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37735 } } }
I20260807 20:17:25.578647 31008 sys_catalog.cc:564] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:25.578713 31015 sys_catalog.cc:458] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:17:25.578876 31013 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:25.578935 31013 raft_consensus.cc:686] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [term 1 LEADER]: Becoming Leader. State: Replica: e92d288e8037488bb3be93812f71a71b, State: Running, Role: LEADER
I20260807 20:17:25.579010 31013 consensus_queue.cc:237] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e92d288e8037488bb3be93812f71a71b" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37735 } }
I20260807 20:17:25.579312 31015 sys_catalog.cc:455] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e92d288e8037488bb3be93812f71a71b. Latest consensus state: current_term: 1 leader_uuid: "e92d288e8037488bb3be93812f71a71b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e92d288e8037488bb3be93812f71a71b" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37735 } } }
I20260807 20:17:25.579407 31015 sys_catalog.cc:458] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:25.579603 31030 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:25.580197 31030 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:25.581903 31030 catalog_manager.cc:1347] Generated new cluster ID: a9aea350e2714ab4a16abafb364655e6
I20260807 20:17:25.581955 31030 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:17:25 dist-test-slave-t7g5 krb5kdc[30870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133845, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:25.595404 31030 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:25.596004 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:25.578485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44226 (local address 127.30.35.254:37735)
0807 20:17:25.579350 (+ 865us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:25.579360 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:25.580231 (+ 871us) server_negotiation.cc:407] Connection header received
0807 20:17:25.582043 (+ 1812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:25.582051 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:25.582106 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:25.582240 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:25.584084 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:25.585522 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:25.586916 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:25.587548 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:25.587656 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:25.591681 (+ 4025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:25.591685 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:25.591685 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:25.591696 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:25.594020 (+ 2324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:25.594500 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:25.594503 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:25.594504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:25.594606 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:25.594873 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:25.594874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:25.594874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:25.595124 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:25.595272 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:25.595632 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 20:17:25.595766 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":820,"thread_start_us":77,"threads_started":1}
I20260807 20:17:25.596033 31030 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:25.604784 31030 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e92d288e8037488bb3be93812f71a71b: Generated new TSK 0
I20260807 20:17:25.604946 31030 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:17:25.630447 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:37735
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:44875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:25.710987 31045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:25.711186 31045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:25.711210 31045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:25.712314 31045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:25.712355 31045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:25.712383 31045 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:17:25.713845 31045 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:44875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:37735
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31045
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:25.714072 31045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:25.714290 31045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:25.719125 31057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:25.719118 31053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:25.719126 31051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:25.719285 31045 server_base.cc:1034] running on GCE node
I20260807 20:17:25.719451 31045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:25.719645 31045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:25.720786 31045 hybrid_clock.cc:648] HybridClock initialized: now 1786133845720774 us; error 30 us; skew 500 ppm
Aug 07 20:17:25 dist-test-slave-t7g5 krb5kdc[30870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133845, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:25.723140 31045 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:17:25.723580 31045 webserver.cc:460] Webserver started at http://127.30.35.193:46317/ using document root <none> and password file <none>
I20260807 20:17:25.723781 31045 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:25.723829 31045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:25.723963 31045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:25.724963 31045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "529ee051cedc4a11b39322462787e931"
format_stamp: "Formatted at 2026-08-07 20:17:25 on dist-test-slave-t7g5"
server_key: "9c803c3721a93383562bb34a9139c981"
server_key_iv: "0f33c316de29d6ef63646f8f8a697862"
server_key_version: "encryptionkey@0"
I20260807 20:17:25.725282 31045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "529ee051cedc4a11b39322462787e931"
format_stamp: "Formatted at 2026-08-07 20:17:25 on dist-test-slave-t7g5"
server_key: "9c803c3721a93383562bb34a9139c981"
server_key_iv: "0f33c316de29d6ef63646f8f8a697862"
server_key_version: "encryptionkey@0"
I20260807 20:17:25.726531 31045 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:17:25.727169 31065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:25.727315 31045 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:17:25.727398 31045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "529ee051cedc4a11b39322462787e931"
format_stamp: "Formatted at 2026-08-07 20:17:25 on dist-test-slave-t7g5"
server_key: "9c803c3721a93383562bb34a9139c981"
server_key_iv: "0f33c316de29d6ef63646f8f8a697862"
server_key_version: "encryptionkey@0"
I20260807 20:17:25.727458 31045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:25.746891 31045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:25.748598 31045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:25.748737 31045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:25.748956 31045 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:25.749251 31045 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:25.749292 31045 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:25.749321 31045 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:25.749344 31045 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:25.755285 31045 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:35431
I20260807 20:17:25.755328 31242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:35431 every 8 connection(s)
I20260807 20:17:25.755652 31045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
Aug 07 20:17:25 dist-test-slave-t7g5 krb5kdc[30870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133845, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:25.763772 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:25.756312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:46417 (local address 127.30.35.254:37735)
0807 20:17:25.756353 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:25.756355 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:25.756594 (+ 239us) server_negotiation.cc:407] Connection header received
0807 20:17:25.757052 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:25.757053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:25.757069 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:25.757113 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:25.758071 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:25.758572 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:25.759503 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:25.759694 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:25.759740 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:25.761633 (+ 1893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:25.761634 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:25.761634 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:25.761641 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:25.762747 (+ 1106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:25.763094 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:25.763094 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:25.763095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:25.763136 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:25.763305 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:25.763306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:25.763306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:25.763395 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:25.763453 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:25.763649 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 20:17:25.763709 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 20:17:25.763964 31246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:25.756289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:37735 (local address 127.30.35.193:46417)
0807 20:17:25.756469 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:25.756507 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:25.756976 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:25.757177 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:25.757180 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:25.757789 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:25.758001 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:25.758007 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:25.758636 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:25.758637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:25.759438 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:25.759441 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:25.759748 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:25.759749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:25.759848 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:25.760274 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:25.760282 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:25.761543 (+ 1261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:25.762807 (+ 1264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:25.762812 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:25.762814 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:25.763040 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:25.763177 (+ 137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:25.763178 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:25.763178 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:25.763266 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:25.763448 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:25.763450 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:25.763556 (+ 106us) client_negotiation.cc:769] Sending connection context
0807 20:17:25.763631 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 20:17:25.763745 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":113,"threads_started":1}
I20260807 20:17:25.764444 31243 heartbeater.cc:347] Connected to a master server at 127.30.35.254:37735
I20260807 20:17:25.764542 31243 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:25.764710 31243 heartbeater.cc:511] Master 127.30.35.254:37735 requested a full tablet report, sending...
I20260807 20:17:25.765105 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 31045
I20260807 20:17:25.765179 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:17:25.765229 30940 ts_manager.cc:194] Registered new tserver with Master: 529ee051cedc4a11b39322462787e931 (127.30.35.193:35431)
I20260807 20:17:25.765323 30863 external_mini_cluster.cc:1428] Setting key b6aa161d0b8319a97c019960bb13e3ab
I20260807 20:17:25.765980 30940 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:46417
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:17:25.792165 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:37735
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:44875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:25.887421 31250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:25.887639 31250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:25.887663 31250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:25.888798 31250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:25.888841 31250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:25.888871 31250 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:17:25.890378 31250 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:44875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:37735
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:25.890619 31250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:25.890846 31250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:25.895885 31258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:25.895975 31250 server_base.cc:1034] running on GCE node
W20260807 20:17:25.895885 31261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:25.895885 31259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:25.896359 31250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:25.896627 31250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:25.897786 31250 hybrid_clock.cc:648] HybridClock initialized: now 1786133845897773 us; error 30 us; skew 500 ppm
Aug 07 20:17:25 dist-test-slave-t7g5 krb5kdc[30870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133845, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:25.900355 31250 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:17:25.900781 31250 webserver.cc:460] Webserver started at http://127.30.35.194:36847/ using document root <none> and password file <none>
I20260807 20:17:25.901019 31250 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:25.901067 31250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:25.901196 31250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:25.902277 31250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "53ecd474881143718627bf6db65864da"
format_stamp: "Formatted at 2026-08-07 20:17:25 on dist-test-slave-t7g5"
server_key: "36599b1fb9db1958e5570d480ea68815"
server_key_iv: "8c4e6a6defe8ee925c1f63ca9dfd7193"
server_key_version: "encryptionkey@0"
I20260807 20:17:25.902614 31250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "53ecd474881143718627bf6db65864da"
format_stamp: "Formatted at 2026-08-07 20:17:25 on dist-test-slave-t7g5"
server_key: "36599b1fb9db1958e5570d480ea68815"
server_key_iv: "8c4e6a6defe8ee925c1f63ca9dfd7193"
server_key_version: "encryptionkey@0"
I20260807 20:17:25.903867 31250 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:25.904662 31270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:25.904841 31250 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:25.904939 31250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "53ecd474881143718627bf6db65864da"
format_stamp: "Formatted at 2026-08-07 20:17:25 on dist-test-slave-t7g5"
server_key: "36599b1fb9db1958e5570d480ea68815"
server_key_iv: "8c4e6a6defe8ee925c1f63ca9dfd7193"
server_key_version: "encryptionkey@0"
I20260807 20:17:25.905000 31250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:25.919529 31250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:25.921326 31250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:25.921474 31250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:25.921717 31250 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:25.922030 31250 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:25.922065 31250 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:25.922094 31250 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:25.922118 31250 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:25.927747 31250 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:38811
I20260807 20:17:25.927805 31443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:38811 every 8 connection(s)
I20260807 20:17:25.928191 31250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
Aug 07 20:17:25 dist-test-slave-t7g5 krb5kdc[30870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133845, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:25.936954 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:25.929133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:55653 (local address 127.30.35.254:37735)
0807 20:17:25.929180 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:25.929182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:25.929422 (+ 240us) server_negotiation.cc:407] Connection header received
0807 20:17:25.929993 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:25.929993 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:25.930019 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:25.930069 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:25.931029 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:25.931513 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:25.932438 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:25.932614 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:25.932657 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:25.934693 (+ 2036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:25.934694 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:25.934695 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:25.934701 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:25.935749 (+ 1048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:25.936106 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:25.936107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:25.936107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:25.936159 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:25.936366 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:25.936367 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:25.936367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:25.936471 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:25.936526 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:25.936774 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 20:17:25.936855 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 20:17:25.937171 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 31250
I20260807 20:17:25.937242 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:17:25.937362 30863 external_mini_cluster.cc:1428] Setting key 1c73b13593f13372cf7d2762248ca23f
I20260807 20:17:25.937580 31446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:25.929145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:37735 (local address 127.30.35.194:55653)
0807 20:17:25.929311 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:25.929348 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:25.929908 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:25.930150 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:25.930154 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:25.930728 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:25.930959 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:25.930964 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:25.931577 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:25.931578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:25.932374 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:25.932377 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:25.932666 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:25.932666 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:25.932761 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:25.933248 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:25.933258 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:25.934605 (+ 1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:25.935817 (+ 1212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:25.935824 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:25.935826 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:25.936037 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:25.936210 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:25.936211 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:25.936211 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:25.936310 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:25.936526 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:25.936533 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:25.936661 (+ 128us) client_negotiation.cc:769] Sending connection context
0807 20:17:25.936748 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 20:17:25.936899 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260807 20:17:25.938117 31444 heartbeater.cc:347] Connected to a master server at 127.30.35.254:37735
I20260807 20:17:25.938205 31444 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:25.938375 31444 heartbeater.cc:511] Master 127.30.35.254:37735 requested a full tablet report, sending...
I20260807 20:17:25.938740 30940 ts_manager.cc:194] Registered new tserver with Master: 53ecd474881143718627bf6db65864da (127.30.35.194:38811)
I20260807 20:17:25.939105 30940 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:55653
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:17:25.962535 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:37735
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:44875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:26.044572 31450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:26.044803 31450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:26.044831 31450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:26.045987 31450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:26.046027 31450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:26.046052 31450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:17:26.047489 31450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:44875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:37735
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:26.047675 31450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:26.047861 31450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:26.052717 31460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:26.052706 31459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:26.052711 31462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:26.053017 31450 server_base.cc:1034] running on GCE node
I20260807 20:17:26.053202 31450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:26.053398 31450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:26.054534 31450 hybrid_clock.cc:648] HybridClock initialized: now 1786133846054522 us; error 29 us; skew 500 ppm
Aug 07 20:17:26 dist-test-slave-t7g5 krb5kdc[30870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133846, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:26.056926 31450 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:17:26.057356 31450 webserver.cc:460] Webserver started at http://127.30.35.195:34835/ using document root <none> and password file <none>
I20260807 20:17:26.057547 31450 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:26.057590 31450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:26.057739 31450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:26.058744 31450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "d62c3c08ba7d4f9182d321d936d96346"
format_stamp: "Formatted at 2026-08-07 20:17:26 on dist-test-slave-t7g5"
server_key: "616cee4cc7e3461a048bd54fbb1d076d"
server_key_iv: "9313bdf9302b143b0f23c1fc7d9c4209"
server_key_version: "encryptionkey@0"
I20260807 20:17:26.059080 31450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "d62c3c08ba7d4f9182d321d936d96346"
format_stamp: "Formatted at 2026-08-07 20:17:26 on dist-test-slave-t7g5"
server_key: "616cee4cc7e3461a048bd54fbb1d076d"
server_key_iv: "9313bdf9302b143b0f23c1fc7d9c4209"
server_key_version: "encryptionkey@0"
I20260807 20:17:26.060276 31450 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:26.060953 31477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:26.061100 31450 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:26.061182 31450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "d62c3c08ba7d4f9182d321d936d96346"
format_stamp: "Formatted at 2026-08-07 20:17:26 on dist-test-slave-t7g5"
server_key: "616cee4cc7e3461a048bd54fbb1d076d"
server_key_iv: "9313bdf9302b143b0f23c1fc7d9c4209"
server_key_version: "encryptionkey@0"
I20260807 20:17:26.061245 31450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:26.069638 31450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:26.071666 31450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:26.071807 31450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:26.072010 31450 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:26.072292 31450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:26.072328 31450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:26.072348 31450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:26.072371 31450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:26.078152 31450 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:37241
I20260807 20:17:26.078222 31659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:37241 every 8 connection(s)
I20260807 20:17:26.078510 31450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
Aug 07 20:17:26 dist-test-slave-t7g5 krb5kdc[30870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133846, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:26.087296 31016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:26.079248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:60747 (local address 127.30.35.254:37735)
0807 20:17:26.079310 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:26.079334 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:26.079667 (+ 333us) server_negotiation.cc:407] Connection header received
0807 20:17:26.080169 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:26.080171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:26.080183 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:26.080258 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:26.081209 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:26.081784 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:26.082759 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:26.082952 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:26.083010 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:26.084995 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:26.084997 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:26.084997 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:26.085004 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:26.086208 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:26.086549 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:26.086549 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:26.086550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:26.086603 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:26.086789 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:26.086790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:26.086790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:26.086895 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:26.086945 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:26.087159 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 20:17:26.087231 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 20:17:26.087450 31662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:26.079236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:37735 (local address 127.30.35.195:60747)
0807 20:17:26.079526 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:26.079565 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:26.080039 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:26.080321 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:26.080325 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:26.080913 (+ 588us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:26.081121 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:26.081126 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:26.081856 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:26.081856 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:26.082667 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:26.082669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:26.083019 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:26.083019 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:26.083120 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:26.083550 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:26.083557 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:26.084893 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:26.086281 (+ 1388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:26.086287 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:26.086288 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:26.086491 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:26.086650 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:26.086651 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:26.086651 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:26.086744 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:26.086952 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:26.086955 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:26.087064 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 20:17:26.087139 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 20:17:26.087254 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":95,"threads_started":1}
I20260807 20:17:26.087628 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 31450
I20260807 20:17:26.087749 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:17:26.087931 30863 external_mini_cluster.cc:1428] Setting key 4b46c466edc96c302ea1ff6591372d47
I20260807 20:17:26.088236 31660 heartbeater.cc:347] Connected to a master server at 127.30.35.254:37735
I20260807 20:17:26.088330 31660 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:26.088536 31660 heartbeater.cc:511] Master 127.30.35.254:37735 requested a full tablet report, sending...
I20260807 20:17:26.088941 30940 ts_manager.cc:194] Registered new tserver with Master: d62c3c08ba7d4f9182d321d936d96346 (127.30.35.195:37241)
I20260807 20:17:26.089286 30940 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:60747
I20260807 20:17:26.100013 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 20:17:26 dist-test-slave-t7g5 krb5kdc[30870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133846, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 20:17:26 dist-test-slave-t7g5 krb5kdc[30870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133846, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.35.193@KRBTEST.COM
I20260807 20:17:26.125154 31668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:26.117744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52648 (local address 127.30.35.193:35431)
0807 20:17:26.117933 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:26.117938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:26.117950 (+ 12us) server_negotiation.cc:407] Connection header received
0807 20:17:26.117979 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:26.117981 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:26.117997 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:26.118063 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:26.118582 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:26.119315 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:26.119993 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:26.120308 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:26.120377 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:26.122546 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:26.122557 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:26.122557 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:26.122564 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:26.124019 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:26.124345 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:26.124348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:26.124349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:26.124418 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:26.124586 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:26.124587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:26.124587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:26.124728 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:26.124882 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:26.124954 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 20:17:26.125038 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":100,"threads_started":1}
W20260807 20:17:26.125528 31107 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52648
Aug 07 20:17:26 dist-test-slave-t7g5 krb5kdc[30870](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 20:17:26 dist-test-slave-t7g5 krb5kdc[30870](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133846, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.193@KRBTEST.COM
I20260807 20:17:26.147482 31668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:26.141105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52650 (local address 127.30.35.193:35431)
0807 20:17:26.141151 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:26.141153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:26.141212 (+ 59us) server_negotiation.cc:407] Connection header received
0807 20:17:26.141259 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:26.141259 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:26.141268 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:26.141313 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:26.141857 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:26.142386 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:26.143109 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:26.143301 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:26.143343 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:26.145547 (+ 2204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:26.145548 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:26.145549 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:26.145556 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:26.146628 (+ 1072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:26.146957 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:26.146958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:26.146958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:26.147006 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:26.147133 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:26.147133 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:26.147134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:26.147213 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:26.147297 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:26.147351 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 20:17:26.147411 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 20:17:26.148000 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 31045
I20260807 20:17:26.163390 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 31250
I20260807 20:17:26.168417 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 31450
I20260807 20:17:26.178932 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 30888
2026-08-07T20:17:26Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2002 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:17:26 dist-test-slave-t7g5 krb5kdc[31679](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:17:26 dist-test-slave-t7g5 krb5kdc[31679](info): set up 2 sockets
Aug 07 20:17:26 dist-test-slave-t7g5 krb5kdc[31679](info): commencing operation
krb5kdc: starting...
W20260807 20:17:27.312314 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:17:27 dist-test-slave-t7g5 krb5kdc[31679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:17:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:17:27.425918 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:40737
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:40737
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:27.505237 31699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:27.505461 31699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:27.505493 31699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:27.506680 31699 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:27.506724 31699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:27.506743 31699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:27.506759 31699 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:27.506775 31699 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:27.508255 31699 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:40737
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:40737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:27.508513 31699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:27.508724 31699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:27.513481 31711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:27.513495 31713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:27.513535 31710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:27.513567 31699 server_base.cc:1034] running on GCE node
I20260807 20:17:27.513929 31699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:27.514179 31699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:27.515336 31699 hybrid_clock.cc:648] HybridClock initialized: now 1786133847515319 us; error 34 us; skew 500 ppm
Aug 07 20:17:27 dist-test-slave-t7g5 krb5kdc[31679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133847, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:27.517777 31699 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:17:27.518201 31699 webserver.cc:460] Webserver started at http://127.30.35.254:34189/ using document root <none> and password file <none>
I20260807 20:17:27.518422 31699 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:27.518471 31699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:27.518596 31699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:27.519608 31699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "eee33b349d4c49d1a564350eec2b3048"
format_stamp: "Formatted at 2026-08-07 20:17:27 on dist-test-slave-t7g5"
server_key: "45842962cbb8148673d1b1eeed18b08c"
server_key_iv: "8b1a3c88c4191051b5caeabeb8675c36"
server_key_version: "encryptionkey@0"
I20260807 20:17:27.519948 31699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "eee33b349d4c49d1a564350eec2b3048"
format_stamp: "Formatted at 2026-08-07 20:17:27 on dist-test-slave-t7g5"
server_key: "45842962cbb8148673d1b1eeed18b08c"
server_key_iv: "8b1a3c88c4191051b5caeabeb8675c36"
server_key_version: "encryptionkey@0"
I20260807 20:17:27.521158 31699 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:17:27.521845 31721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:27.522006 31699 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:27.522089 31699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "eee33b349d4c49d1a564350eec2b3048"
format_stamp: "Formatted at 2026-08-07 20:17:27 on dist-test-slave-t7g5"
server_key: "45842962cbb8148673d1b1eeed18b08c"
server_key_iv: "8b1a3c88c4191051b5caeabeb8675c36"
server_key_version: "encryptionkey@0"
I20260807 20:17:27.522148 31699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:27.550351 31699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:27.552467 31699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:27.552606 31699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:27.556275 31699 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:40737
I20260807 20:17:27.556319 31799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:40737 every 8 connection(s)
I20260807 20:17:27.556644 31699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:27.557497 31800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:27.559757 31800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048: Bootstrap starting.
I20260807 20:17:27.560279 31800 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:27.560530 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 31699
I20260807 20:17:27.560617 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:27.560621 31800 log.cc:824] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:27.560777 30863 external_mini_cluster.cc:1428] Setting key 6fae0348e1923eac59fb9bc4c7329aa6
I20260807 20:17:27.561412 31800 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048: No bootstrap required, opened a new log
I20260807 20:17:27.563838 31800 raft_consensus.cc:348] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eee33b349d4c49d1a564350eec2b3048" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40737 } }
I20260807 20:17:27.564009 31800 raft_consensus.cc:374] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:27.564056 31800 raft_consensus.cc:729] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eee33b349d4c49d1a564350eec2b3048, State: Initialized, Role: FOLLOWER
I20260807 20:17:27.564178 31800 consensus_queue.cc:260] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eee33b349d4c49d1a564350eec2b3048" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40737 } }
I20260807 20:17:27.564249 31800 raft_consensus.cc:388] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:27.564281 31800 raft_consensus.cc:482] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:27.564322 31800 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:27.564919 31800 raft_consensus.cc:504] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eee33b349d4c49d1a564350eec2b3048" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40737 } }
I20260807 20:17:27.565009 31800 leader_election.cc:302] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eee33b349d4c49d1a564350eec2b3048; no voters:
I20260807 20:17:27.565164 31800 leader_election.cc:288] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:27.565256 31806 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:27.565497 31800 sys_catalog.cc:564] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:27.565765 31806 raft_consensus.cc:686] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [term 1 LEADER]: Becoming Leader. State: Replica: eee33b349d4c49d1a564350eec2b3048, State: Running, Role: LEADER
I20260807 20:17:27.565863 31806 consensus_queue.cc:237] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eee33b349d4c49d1a564350eec2b3048" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40737 } }
I20260807 20:17:27.566236 31811 sys_catalog.cc:455] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eee33b349d4c49d1a564350eec2b3048" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eee33b349d4c49d1a564350eec2b3048" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40737 } } }
I20260807 20:17:27.566247 31808 sys_catalog.cc:455] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eee33b349d4c49d1a564350eec2b3048. Latest consensus state: current_term: 1 leader_uuid: "eee33b349d4c49d1a564350eec2b3048" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eee33b349d4c49d1a564350eec2b3048" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40737 } } }
I20260807 20:17:27.566329 31811 sys_catalog.cc:458] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:27.566334 31808 sys_catalog.cc:458] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:27.566524 31819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:27.566984 31819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 20:17:27 dist-test-slave-t7g5 krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:27.568639 31819 catalog_manager.cc:1347] Generated new cluster ID: 24001f08cc654635b69b1e3a9aad255a
I20260807 20:17:27.568686 31819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:17:27.571662 31805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:27.561293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44034 (local address 127.30.35.254:40737)
0807 20:17:27.561443 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:27.561453 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:27.561486 (+ 33us) server_negotiation.cc:407] Connection header received
0807 20:17:27.561943 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:27.561950 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:27.562000 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:27.562108 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:27.562796 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:27.563658 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:27.564656 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:27.565101 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:27.565196 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:27.568039 (+ 2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:27.568043 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:27.568043 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:27.568055 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:27.570106 (+ 2051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:27.570482 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:27.570485 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:27.570485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:27.570594 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:27.570762 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:27.570763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:27.570763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:27.571059 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:27.571236 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:27.571303 (+ 67us) server_negotiation.cc:299] Negotiation successful
0807 20:17:27.571453 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":64,"threads_started":1}
I20260807 20:17:27.580024 31819 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:27.580719 31819 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:27.589195 31819 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eee33b349d4c49d1a564350eec2b3048: Generated new TSK 0
I20260807 20:17:27.589360 31819 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:17:27.624145 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40737
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:27.704152 31838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:27.704355 31838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:27.704384 31838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:27.705500 31838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:27.705541 31838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:27.705575 31838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:17:27.707041 31838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40737
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:27.707274 31838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:27.707484 31838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:27.712277 31855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:27.712289 31851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:27.712325 31838 server_base.cc:1034] running on GCE node
W20260807 20:17:27.712297 31859 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:27.712723 31838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:27.712949 31838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:27.714084 31838 hybrid_clock.cc:648] HybridClock initialized: now 1786133847714072 us; error 31 us; skew 500 ppm
Aug 07 20:17:27 dist-test-slave-t7g5 krb5kdc[31679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133847, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:27.716586 31838 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:17:27.717008 31838 webserver.cc:460] Webserver started at http://127.30.35.193:33011/ using document root <none> and password file <none>
I20260807 20:17:27.717226 31838 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:27.717268 31838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:27.717404 31838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:27.718461 31838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "946ddb3b01ff4972ba9ac7428ef93721"
format_stamp: "Formatted at 2026-08-07 20:17:27 on dist-test-slave-t7g5"
server_key: "328fe5cc97f9ff2d38232497ff22e462"
server_key_iv: "7f31c80e1a457ebedf45a15fd60e1be4"
server_key_version: "encryptionkey@0"
I20260807 20:17:27.718781 31838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "946ddb3b01ff4972ba9ac7428ef93721"
format_stamp: "Formatted at 2026-08-07 20:17:27 on dist-test-slave-t7g5"
server_key: "328fe5cc97f9ff2d38232497ff22e462"
server_key_iv: "7f31c80e1a457ebedf45a15fd60e1be4"
server_key_version: "encryptionkey@0"
I20260807 20:17:27.720026 31838 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 20:17:27.720845 31871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:27.721033 31838 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:17:27.721124 31838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "946ddb3b01ff4972ba9ac7428ef93721"
format_stamp: "Formatted at 2026-08-07 20:17:27 on dist-test-slave-t7g5"
server_key: "328fe5cc97f9ff2d38232497ff22e462"
server_key_iv: "7f31c80e1a457ebedf45a15fd60e1be4"
server_key_version: "encryptionkey@0"
I20260807 20:17:27.721194 31838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:27.742226 31838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:27.744372 31838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:27.744513 31838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:27.744720 31838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:27.745018 31838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:27.745052 31838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:27.745081 31838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:27.745105 31838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:27.750754 31838 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:45771
I20260807 20:17:27.750809 32042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:45771 every 8 connection(s)
I20260807 20:17:27.751106 31838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
Aug 07 20:17:27 dist-test-slave-t7g5 krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133847, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:27.759220 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 31838
I20260807 20:17:27.759311 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:17:27.759505 30863 external_mini_cluster.cc:1428] Setting key 18a5cfe6bdd3d50712090ebdd508ce48
I20260807 20:17:27.759931 31805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:27.751828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:41469 (local address 127.30.35.254:40737)
0807 20:17:27.751920 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:27.751922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:27.752079 (+ 157us) server_negotiation.cc:407] Connection header received
0807 20:17:27.753102 (+ 1023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:27.753103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:27.753113 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:27.753163 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:27.753769 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:27.754264 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:27.755197 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:27.755392 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:27.755438 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:27.757481 (+ 2043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:27.757482 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:27.757483 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:27.757491 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:27.758623 (+ 1132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:27.758992 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:27.758993 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:27.758994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:27.759049 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:27.759294 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:27.759295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:27.759296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:27.759429 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:27.759496 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:27.759761 (+ 265us) server_negotiation.cc:299] Negotiation successful
0807 20:17:27.759846 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 20:17:27.760078 32046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:27.751794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40737 (local address 127.30.35.193:41469)
0807 20:17:27.751960 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:27.751997 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:27.753016 (+ 1019us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:27.753222 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:27.753225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:27.753478 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:27.753699 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:27.753707 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:27.754331 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:27.754332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:27.755132 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:27.755134 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:27.755449 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:27.755449 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:27.755557 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:27.756024 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:27.756032 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:27.757387 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:27.758697 (+ 1310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:27.758705 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:27.758707 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:27.758923 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:27.759117 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:27.759118 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:27.759118 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:27.759230 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:27.759489 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:27.759495 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:27.759633 (+ 138us) client_negotiation.cc:769] Sending connection context
0807 20:17:27.759720 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 20:17:27.759883 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":87,"threads_started":1}
I20260807 20:17:27.760546 32044 heartbeater.cc:347] Connected to a master server at 127.30.35.254:40737
I20260807 20:17:27.760648 32044 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:27.760831 32044 heartbeater.cc:511] Master 127.30.35.254:40737 requested a full tablet report, sending...
I20260807 20:17:27.761314 31743 ts_manager.cc:194] Registered new tserver with Master: 946ddb3b01ff4972ba9ac7428ef93721 (127.30.35.193:45771)
I20260807 20:17:27.761994 31743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:41469
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:17:27.782634 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40737
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:27.862818 32053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:27.863041 32053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:27.863075 32053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:27.864197 32053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:27.864238 32053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:27.864272 32053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:17:27.865785 32053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40737
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:27.866014 32053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:27.866243 32053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:27.870931 32063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:27.870939 32064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:27.870970 32053 server_base.cc:1034] running on GCE node
W20260807 20:17:27.870955 32067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:27.871382 32053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:27.871606 32053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:27.872753 32053 hybrid_clock.cc:648] HybridClock initialized: now 1786133847872739 us; error 33 us; skew 500 ppm
Aug 07 20:17:27 dist-test-slave-t7g5 krb5kdc[31679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133847, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:27.875147 32053 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:17:27.875550 32053 webserver.cc:460] Webserver started at http://127.30.35.194:38149/ using document root <none> and password file <none>
I20260807 20:17:27.875744 32053 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:27.875792 32053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:27.875921 32053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:27.876926 32053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "b030eb94d2204c3f9e54197603ec60d5"
format_stamp: "Formatted at 2026-08-07 20:17:27 on dist-test-slave-t7g5"
server_key: "8a16a35c71ac6787f24491e1901e4e96"
server_key_iv: "065feb1c0d1aad1ebfa9d0af0433634a"
server_key_version: "encryptionkey@0"
I20260807 20:17:27.877244 32053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "b030eb94d2204c3f9e54197603ec60d5"
format_stamp: "Formatted at 2026-08-07 20:17:27 on dist-test-slave-t7g5"
server_key: "8a16a35c71ac6787f24491e1901e4e96"
server_key_iv: "065feb1c0d1aad1ebfa9d0af0433634a"
server_key_version: "encryptionkey@0"
I20260807 20:17:27.878511 32053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260807 20:17:27.879158 32077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:27.879300 32053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:27.879381 32053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "b030eb94d2204c3f9e54197603ec60d5"
format_stamp: "Formatted at 2026-08-07 20:17:27 on dist-test-slave-t7g5"
server_key: "8a16a35c71ac6787f24491e1901e4e96"
server_key_iv: "065feb1c0d1aad1ebfa9d0af0433634a"
server_key_version: "encryptionkey@0"
I20260807 20:17:27.879441 32053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:27.886720 32053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:27.888273 32053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:27.888401 32053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:27.888583 32053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:27.888846 32053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:27.888887 32053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:27.888914 32053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:27.888938 32053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:27.894385 32053 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:32911
I20260807 20:17:27.894431 32249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:32911 every 8 connection(s)
I20260807 20:17:27.894712 32053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:17:27.896705 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 32053
I20260807 20:17:27.896791 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:17:27.896935 30863 external_mini_cluster.cc:1428] Setting key a03c89765b864dadd86ebbcbba3464bc
Aug 07 20:17:27 dist-test-slave-t7g5 krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133847, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:27.904170 31805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:27.895349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:51989 (local address 127.30.35.254:40737)
0807 20:17:27.895428 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:27.895430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:27.895595 (+ 165us) server_negotiation.cc:407] Connection header received
0807 20:17:27.896471 (+ 876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:27.896472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:27.896483 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:27.896532 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:27.897172 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:27.897789 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:27.899098 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:27.899299 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:27.899374 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:27.901445 (+ 2071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:27.901446 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:27.901447 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:27.901454 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:27.902883 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:27.903293 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:27.903294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:27.903295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:27.903359 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:27.903581 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:27.903581 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:27.903582 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:27.903715 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:27.903785 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:27.903998 (+ 213us) server_negotiation.cc:299] Negotiation successful
0807 20:17:27.904080 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 20:17:27.904229 32258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:27.895317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40737 (local address 127.30.35.194:51989)
0807 20:17:27.895482 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:27.895519 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:27.896380 (+ 861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:27.896588 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:27.896591 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:27.896859 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:27.897086 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:27.897092 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:27.897871 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:27.897872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:27.899013 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:27.899016 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:27.899387 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:27.899388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:27.899506 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:27.899980 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:27.899989 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:27.901360 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:27.902958 (+ 1598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:27.902964 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:27.902966 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:27.903217 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:27.903432 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:27.903432 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:27.903432 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:27.903526 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:27.903770 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:27.903773 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:27.903879 (+ 106us) client_negotiation.cc:769] Sending connection context
0807 20:17:27.903956 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 20:17:27.904071 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":76,"threads_started":1}
I20260807 20:17:27.904767 32254 heartbeater.cc:347] Connected to a master server at 127.30.35.254:40737
I20260807 20:17:27.904855 32254 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:27.905021 32254 heartbeater.cc:511] Master 127.30.35.254:40737 requested a full tablet report, sending...
I20260807 20:17:27.905387 31743 ts_manager.cc:194] Registered new tserver with Master: b030eb94d2204c3f9e54197603ec60d5 (127.30.35.194:32911)
I20260807 20:17:27.905794 31743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:51989
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:17:27.923573 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40737
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:28.006336 32262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:28.006548 32262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:28.006572 32262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:28.007664 32262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:28.007696 32262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:28.007721 32262 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:17:28.009155 32262 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40737
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:28.009341 32262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:28.009522 32262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:28.014377 32270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:28.014389 32269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:28.014531 32262 server_base.cc:1034] running on GCE node
W20260807 20:17:28.014576 32272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:28.014772 32262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:28.014988 32262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:28.016124 32262 hybrid_clock.cc:648] HybridClock initialized: now 1786133848016105 us; error 32 us; skew 500 ppm
Aug 07 20:17:28 dist-test-slave-t7g5 krb5kdc[31679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133848, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:28.018667 32262 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:17:28.019043 32262 webserver.cc:460] Webserver started at http://127.30.35.195:38569/ using document root <none> and password file <none>
I20260807 20:17:28.019237 32262 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:28.019275 32262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:28.019364 32262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:28.020319 32262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "ab9667b26c724560bc7d1c3046938a7e"
format_stamp: "Formatted at 2026-08-07 20:17:28 on dist-test-slave-t7g5"
server_key: "c5a34a0e27be29ae53c00a59a2f3718f"
server_key_iv: "e92c1359fe4c94f61f94986c75317bd2"
server_key_version: "encryptionkey@0"
I20260807 20:17:28.020642 32262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "ab9667b26c724560bc7d1c3046938a7e"
format_stamp: "Formatted at 2026-08-07 20:17:28 on dist-test-slave-t7g5"
server_key: "c5a34a0e27be29ae53c00a59a2f3718f"
server_key_iv: "e92c1359fe4c94f61f94986c75317bd2"
server_key_version: "encryptionkey@0"
I20260807 20:17:28.021816 32262 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:17:28.022424 32279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:28.022573 32262 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:28.022658 32262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "ab9667b26c724560bc7d1c3046938a7e"
format_stamp: "Formatted at 2026-08-07 20:17:28 on dist-test-slave-t7g5"
server_key: "c5a34a0e27be29ae53c00a59a2f3718f"
server_key_iv: "e92c1359fe4c94f61f94986c75317bd2"
server_key_version: "encryptionkey@0"
I20260807 20:17:28.022712 32262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:28.030346 32262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:28.032258 32262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:28.032361 32262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:28.032528 32262 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:28.032759 32262 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:28.032788 32262 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:28.032807 32262 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:28.032822 32262 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:28.038219 32262 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:35829
I20260807 20:17:28.038266 32466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:35829 every 8 connection(s)
I20260807 20:17:28.038560 32262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
Aug 07 20:17:28 dist-test-slave-t7g5 krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133848, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:28.047173 31805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.039220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:52571 (local address 127.30.35.254:40737)
0807 20:17:28.039295 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:28.039297 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:28.039435 (+ 138us) server_negotiation.cc:407] Connection header received
0807 20:17:28.040331 (+ 896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:28.040332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:28.040342 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:28.040379 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:28.040965 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.041461 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.042491 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.042683 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.042739 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.044779 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:28.044780 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:28.044781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:28.044788 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:28.046105 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:28.046457 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:28.046458 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:28.046459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:28.046511 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:28.046674 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:28.046674 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:28.046674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:28.046794 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:28.046842 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:28.047043 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 20:17:28.047109 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 20:17:28.047307 32474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.039183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40737 (local address 127.30.35.195:52571)
0807 20:17:28.039324 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:28.039359 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:28.040236 (+ 877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:28.040447 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:28.040450 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:28.040691 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:28.040871 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.040876 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.041533 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.041534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.042404 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.042407 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.042745 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.042746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.042840 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.043284 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:28.043293 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:28.044662 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:28.046182 (+ 1520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:28.046187 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:28.046189 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:28.046394 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:28.046556 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:28.046556 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:28.046556 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:28.046638 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:28.046837 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:28.046839 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:28.046947 (+ 108us) client_negotiation.cc:769] Sending connection context
0807 20:17:28.047021 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 20:17:28.047135 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":77,"threads_started":1}
I20260807 20:17:28.047716 32467 heartbeater.cc:347] Connected to a master server at 127.30.35.254:40737
I20260807 20:17:28.047838 32467 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:28.048012 32467 heartbeater.cc:511] Master 127.30.35.254:40737 requested a full tablet report, sending...
I20260807 20:17:28.048357 31743 ts_manager.cc:194] Registered new tserver with Master: ab9667b26c724560bc7d1c3046938a7e (127.30.35.195:35829)
I20260807 20:17:28.048588 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 32262
I20260807 20:17:28.048686 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:17:28.048750 31743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:52571
I20260807 20:17:28.048929 30863 external_mini_cluster.cc:1428] Setting key ef8960240d94038479ea207388d95ba5
I20260807 20:17:28.049749 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:17:28.056289 31805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.051237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44038 (local address 127.30.35.254:40737)
0807 20:17:28.051279 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:28.051281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:28.051397 (+ 116us) server_negotiation.cc:407] Connection header received
0807 20:17:28.051447 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:28.051447 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:28.051455 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:28.051486 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:28.051972 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.052422 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.053076 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.053241 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.053280 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.054303 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:28.054304 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:28.054304 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:28.054310 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:28.055495 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:28.055740 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:28.055740 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:28.055740 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:28.055781 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:28.055894 (+ 113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:28.055895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:28.055895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:28.056024 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:28.056095 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:28.056163 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 20:17:28.056218 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:17:28.058226 31743 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44038:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:17:28.059746 31743 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:28.065550 32485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.061756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:35829 (local address 127.0.0.1:37852)
0807 20:17:28.061883 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:28.061928 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:28.061995 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:28.062427 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:28.062428 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:28.062430 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:28.062461 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.062462 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.063407 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.063408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.064322 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.064324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.065237 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.065238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.065317 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.065333 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 20:17:28.065416 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 20:17:28.065471 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"mutex_wait_us":21,"thread_start_us":55,"threads_started":1}
I20260807 20:17:28.065550 32486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.061858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37852 (local address 127.30.35.195:35829)
0807 20:17:28.062265 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:28.062269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:28.062278 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:28.062312 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:28.062316 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:28.062330 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:28.062416 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:28.062524 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.063318 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.064404 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.065167 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.065233 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.065287 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:28.065432 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 20:17:28.065471 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":97,"threads_started":1}
I20260807 20:17:28.066000 32490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.062097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54904 (local address 127.30.35.193:45771)
0807 20:17:28.062243 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:28.062247 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:28.062579 (+ 332us) server_negotiation.cc:407] Connection header received
0807 20:17:28.062636 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:28.062639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:28.062656 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:28.062728 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:28.062812 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.063549 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.064787 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.065510 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.065566 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.065619 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:28.065876 (+ 257us) server_negotiation.cc:299] Negotiation successful
0807 20:17:28.065924 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
I20260807 20:17:28.065958 32483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.061961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:45771 (local address 127.0.0.1:54904)
0807 20:17:28.062513 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:28.062522 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:28.062577 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:28.062723 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:28.062724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:28.062726 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:28.062762 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.062763 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.063655 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.063656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.064709 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.064711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.065694 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.065695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.065759 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.065764 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:17:28.065811 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 20:17:28.065848 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":49,"threads_started":1}
I20260807 20:17:28.066762 32489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.062058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43678 (local address 127.30.35.194:32911)
0807 20:17:28.062217 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:28.062222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:28.062233 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:17:28.062273 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:28.062276 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:28.062291 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:28.062380 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:28.063421 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.064428 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.065644 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.066355 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.066467 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.066526 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:28.066651 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 20:17:28.066690 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
I20260807 20:17:28.066761 32487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.061756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:32911 (local address 127.0.0.1:43678)
0807 20:17:28.062057 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:28.062068 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:28.062118 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:28.062386 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:28.062389 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:28.062391 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:28.062460 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.062462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.064517 (+ 2055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.064518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.065512 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.065515 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.066514 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.066515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.066580 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.066584 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:28.066633 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 20:17:28.066672 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":2,"thread_start_us":60,"threads_started":1}
I20260807 20:17:28.066891 32366 tablet_service.cc:1467] Processing CreateTablet for tablet 3219a87ddd124c1dbb77a5b2ad404c8c (DEFAULT_TABLE table=test-table [id=f85fc6e10d1a4d04aab77bc578c6e25b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:28.067272 32366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3219a87ddd124c1dbb77a5b2ad404c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:28.067344 32152 tablet_service.cc:1467] Processing CreateTablet for tablet 3219a87ddd124c1dbb77a5b2ad404c8c (DEFAULT_TABLE table=test-table [id=f85fc6e10d1a4d04aab77bc578c6e25b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:28.067675 32152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3219a87ddd124c1dbb77a5b2ad404c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:28.069993 32492 tablet_bootstrap.cc:492] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e: Bootstrap starting.
I20260807 20:17:28.070132 31941 tablet_service.cc:1467] Processing CreateTablet for tablet 3219a87ddd124c1dbb77a5b2ad404c8c (DEFAULT_TABLE table=test-table [id=f85fc6e10d1a4d04aab77bc578c6e25b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:28.070335 32493 tablet_bootstrap.cc:492] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5: Bootstrap starting.
I20260807 20:17:28.070459 31941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3219a87ddd124c1dbb77a5b2ad404c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:28.070669 32492 tablet_bootstrap.cc:654] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:28.070942 32493 tablet_bootstrap.cc:654] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:28.071467 32493 log.cc:824] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:28.071483 32492 log.cc:824] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:28.072182 32493 tablet_bootstrap.cc:492] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5: No bootstrap required, opened a new log
I20260807 20:17:28.072190 32492 tablet_bootstrap.cc:492] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e: No bootstrap required, opened a new log
I20260807 20:17:28.072244 32493 ts_tablet_manager.cc:1397] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:28.072244 32492 ts_tablet_manager.cc:1397] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:17:28.072935 32497 tablet_bootstrap.cc:492] T 3219a87ddd124c1dbb77a5b2ad404c8c P 946ddb3b01ff4972ba9ac7428ef93721: Bootstrap starting.
I20260807 20:17:28.073526 32497 tablet_bootstrap.cc:654] T 3219a87ddd124c1dbb77a5b2ad404c8c P 946ddb3b01ff4972ba9ac7428ef93721: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:28.074023 32497 log.cc:824] T 3219a87ddd124c1dbb77a5b2ad404c8c P 946ddb3b01ff4972ba9ac7428ef93721: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:28.074147 32493 raft_consensus.cc:348] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b030eb94d2204c3f9e54197603ec60d5" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 32911 } } peers { permanent_uuid: "ab9667b26c724560bc7d1c3046938a7e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35829 } } peers { permanent_uuid: "946ddb3b01ff4972ba9ac7428ef93721" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45771 } }
I20260807 20:17:28.074147 32492 raft_consensus.cc:348] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b030eb94d2204c3f9e54197603ec60d5" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 32911 } } peers { permanent_uuid: "ab9667b26c724560bc7d1c3046938a7e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35829 } } peers { permanent_uuid: "946ddb3b01ff4972ba9ac7428ef93721" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45771 } }
I20260807 20:17:28.074334 32493 raft_consensus.cc:374] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:28.074334 32492 raft_consensus.cc:374] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:28.074380 32492 raft_consensus.cc:729] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab9667b26c724560bc7d1c3046938a7e, State: Initialized, Role: FOLLOWER
I20260807 20:17:28.074380 32493 raft_consensus.cc:729] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b030eb94d2204c3f9e54197603ec60d5, State: Initialized, Role: FOLLOWER
I20260807 20:17:28.074492 32493 consensus_queue.cc:260] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b030eb94d2204c3f9e54197603ec60d5" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 32911 } } peers { permanent_uuid: "ab9667b26c724560bc7d1c3046938a7e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35829 } } peers { permanent_uuid: "946ddb3b01ff4972ba9ac7428ef93721" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45771 } }
I20260807 20:17:28.074506 32492 consensus_queue.cc:260] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b030eb94d2204c3f9e54197603ec60d5" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 32911 } } peers { permanent_uuid: "ab9667b26c724560bc7d1c3046938a7e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35829 } } peers { permanent_uuid: "946ddb3b01ff4972ba9ac7428ef93721" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45771 } }
I20260807 20:17:28.074744 32497 tablet_bootstrap.cc:492] T 3219a87ddd124c1dbb77a5b2ad404c8c P 946ddb3b01ff4972ba9ac7428ef93721: No bootstrap required, opened a new log
I20260807 20:17:28.074770 32492 ts_tablet_manager.cc:1428] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 20:17:28.074770 32493 ts_tablet_manager.cc:1428] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 20:17:28.074805 32497 ts_tablet_manager.cc:1397] T 3219a87ddd124c1dbb77a5b2ad404c8c P 946ddb3b01ff4972ba9ac7428ef93721: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 20:17:28.074882 32467 heartbeater.cc:503] Master 127.30.35.254:40737 was elected leader, sending a full tablet report...
I20260807 20:17:28.074895 32254 heartbeater.cc:503] Master 127.30.35.254:40737 was elected leader, sending a full tablet report...
I20260807 20:17:28.076790 32497 raft_consensus.cc:348] T 3219a87ddd124c1dbb77a5b2ad404c8c P 946ddb3b01ff4972ba9ac7428ef93721 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b030eb94d2204c3f9e54197603ec60d5" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 32911 } } peers { permanent_uuid: "ab9667b26c724560bc7d1c3046938a7e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35829 } } peers { permanent_uuid: "946ddb3b01ff4972ba9ac7428ef93721" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45771 } }
I20260807 20:17:28.076928 32497 raft_consensus.cc:374] T 3219a87ddd124c1dbb77a5b2ad404c8c P 946ddb3b01ff4972ba9ac7428ef93721 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:28.076972 32497 raft_consensus.cc:729] T 3219a87ddd124c1dbb77a5b2ad404c8c P 946ddb3b01ff4972ba9ac7428ef93721 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 946ddb3b01ff4972ba9ac7428ef93721, State: Initialized, Role: FOLLOWER
I20260807 20:17:28.077083 32497 consensus_queue.cc:260] T 3219a87ddd124c1dbb77a5b2ad404c8c P 946ddb3b01ff4972ba9ac7428ef93721 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b030eb94d2204c3f9e54197603ec60d5" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 32911 } } peers { permanent_uuid: "ab9667b26c724560bc7d1c3046938a7e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35829 } } peers { permanent_uuid: "946ddb3b01ff4972ba9ac7428ef93721" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45771 } }
I20260807 20:17:28.077302 32497 ts_tablet_manager.cc:1428] T 3219a87ddd124c1dbb77a5b2ad404c8c P 946ddb3b01ff4972ba9ac7428ef93721: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 20:17:28.077339 32044 heartbeater.cc:503] Master 127.30.35.254:40737 was elected leader, sending a full tablet report...
W20260807 20:17:28.145237 32255 tablet.cc:2369] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:17:28.251792 32045 tablet.cc:2369] T 3219a87ddd124c1dbb77a5b2ad404c8c P 946ddb3b01ff4972ba9ac7428ef93721: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:17:28.289090 32471 tablet.cc:2369] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:17:28.452030 32504 raft_consensus.cc:482] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:28.452179 32504 raft_consensus.cc:504] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b030eb94d2204c3f9e54197603ec60d5" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 32911 } } peers { permanent_uuid: "ab9667b26c724560bc7d1c3046938a7e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35829 } } peers { permanent_uuid: "946ddb3b01ff4972ba9ac7428ef93721" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45771 } }
I20260807 20:17:28.452761 32504 leader_election.cc:288] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b030eb94d2204c3f9e54197603ec60d5 (127.30.35.194:32911), 946ddb3b01ff4972ba9ac7428ef93721 (127.30.35.193:45771)
I20260807 20:17:28.454288 32505 raft_consensus.cc:482] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:28.454401 32505 raft_consensus.cc:504] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b030eb94d2204c3f9e54197603ec60d5" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 32911 } } peers { permanent_uuid: "ab9667b26c724560bc7d1c3046938a7e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35829 } } peers { permanent_uuid: "946ddb3b01ff4972ba9ac7428ef93721" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45771 } }
I20260807 20:17:28.454747 32505 leader_election.cc:288] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab9667b26c724560bc7d1c3046938a7e (127.30.35.195:35829), 946ddb3b01ff4972ba9ac7428ef93721 (127.30.35.193:45771)
I20260807 20:17:28.456117 32474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.452977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:32911 (local address 127.30.35.195:50467)
0807 20:17:28.453032 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:28.453045 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:28.453111 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:28.453260 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:28.453261 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:28.453263 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:28.453336 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.453338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.454072 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.454073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.455148 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.455151 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.455888 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.455889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.455962 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.455965 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:28.456013 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 20:17:28.456051 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260807 20:17:28.456143 32490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.453176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:54329 (local address 127.30.35.193:45771)
0807 20:17:28.453223 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:28.453225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:28.453334 (+ 109us) server_negotiation.cc:407] Connection header received
0807 20:17:28.453367 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:28.453368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:28.453378 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:28.453432 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:28.453566 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.454060 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.455262 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.455803 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.455840 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.455846 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:28.456055 (+ 209us) server_negotiation.cc:299] Negotiation successful
0807 20:17:28.456090 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:17:28.456343 32507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.453093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:45771 (local address 127.30.35.195:54329)
0807 20:17:28.453257 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:28.453266 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:28.453331 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:28.453438 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:28.453440 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:28.453441 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:28.453508 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.453509 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.454152 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.454153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.455167 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.455170 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.455897 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.455898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.455981 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.455984 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:28.456231 (+ 247us) client_negotiation.cc:240] Negotiation successful
0807 20:17:28.456268 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":122,"threads_started":1}
I20260807 20:17:28.456545 32489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.453039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:50467 (local address 127.30.35.194:32911)
0807 20:17:28.453102 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:28.453104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:28.453116 (+ 12us) server_negotiation.cc:407] Connection header received
0807 20:17:28.453187 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:28.453188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:28.453197 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:28.453249 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:28.453416 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.454004 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.455232 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.455771 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.455836 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.455845 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:28.456442 (+ 597us) server_negotiation.cc:299] Negotiation successful
0807 20:17:28.456487 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 20:17:28.456878 31971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3219a87ddd124c1dbb77a5b2ad404c8c" candidate_uuid: "ab9667b26c724560bc7d1c3046938a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946ddb3b01ff4972ba9ac7428ef93721" is_pre_election: true
I20260807 20:17:28.457039 31971 raft_consensus.cc:2454] T 3219a87ddd124c1dbb77a5b2ad404c8c P 946ddb3b01ff4972ba9ac7428ef93721 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9667b26c724560bc7d1c3046938a7e in term 0.
I20260807 20:17:28.457238 32181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3219a87ddd124c1dbb77a5b2ad404c8c" candidate_uuid: "ab9667b26c724560bc7d1c3046938a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b030eb94d2204c3f9e54197603ec60d5" is_pre_election: true
I20260807 20:17:28.457322 32181 raft_consensus.cc:2454] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab9667b26c724560bc7d1c3046938a7e in term 0.
I20260807 20:17:28.457613 32283 leader_election.cc:302] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946ddb3b01ff4972ba9ac7428ef93721, ab9667b26c724560bc7d1c3046938a7e; no voters:
I20260807 20:17:28.457798 32504 raft_consensus.cc:2781] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:28.457859 32504 raft_consensus.cc:482] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:28.457881 32504 raft_consensus.cc:3037] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:28.458386 32486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.455032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:57223 (local address 127.30.35.195:35829)
0807 20:17:28.455066 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:28.455068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:28.455110 (+ 42us) server_negotiation.cc:407] Connection header received
0807 20:17:28.455202 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:28.455203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:28.455211 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:28.455238 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:28.455445 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.456105 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.457585 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.458068 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.458132 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.458140 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:28.458293 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 20:17:28.458330 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 20:17:28.458388 32509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.454886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:35829 (local address 127.30.35.194:57223)
0807 20:17:28.455056 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:28.455064 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:28.455133 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:28.455295 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:28.455295 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:28.455297 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:28.455359 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.455361 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.456189 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.456190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.457516 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.457520 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.458146 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.458147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.458216 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.458220 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:28.458275 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 20:17:28.458310 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":111,"thread_start_us":69,"threads_started":1}
I20260807 20:17:28.458666 32392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3219a87ddd124c1dbb77a5b2ad404c8c" candidate_uuid: "b030eb94d2204c3f9e54197603ec60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab9667b26c724560bc7d1c3046938a7e" is_pre_election: true
I20260807 20:17:28.458720 32504 raft_consensus.cc:504] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b030eb94d2204c3f9e54197603ec60d5" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 32911 } } peers { permanent_uuid: "ab9667b26c724560bc7d1c3046938a7e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35829 } } peers { permanent_uuid: "946ddb3b01ff4972ba9ac7428ef93721" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45771 } }
I20260807 20:17:28.458865 32504 leader_election.cc:288] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [CANDIDATE]: Term 1 election: Requested vote from peers b030eb94d2204c3f9e54197603ec60d5 (127.30.35.194:32911), 946ddb3b01ff4972ba9ac7428ef93721 (127.30.35.193:45771)
I20260807 20:17:28.458943 32392 raft_consensus.cc:2379] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b030eb94d2204c3f9e54197603ec60d5 in current term 1: Already voted for candidate ab9667b26c724560bc7d1c3046938a7e in this term.
I20260807 20:17:28.459072 32508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.454917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:45771 (local address 127.30.35.194:44015)
0807 20:17:28.455239 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:28.455249 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:28.455288 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:28.455511 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:28.455511 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:28.455513 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:28.455564 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.455565 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.456424 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.456425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.457519 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:28.457521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.458813 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.458814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:28.458886 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.458890 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:28.458959 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 20:17:28.458997 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":52,"threads_started":1}
I20260807 20:17:28.459050 31971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3219a87ddd124c1dbb77a5b2ad404c8c" candidate_uuid: "ab9667b26c724560bc7d1c3046938a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946ddb3b01ff4972ba9ac7428ef93721"
I20260807 20:17:28.459052 32181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3219a87ddd124c1dbb77a5b2ad404c8c" candidate_uuid: "ab9667b26c724560bc7d1c3046938a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b030eb94d2204c3f9e54197603ec60d5"
I20260807 20:17:28.459139 32181 raft_consensus.cc:3037] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:28.459121 31971 raft_consensus.cc:3037] T 3219a87ddd124c1dbb77a5b2ad404c8c P 946ddb3b01ff4972ba9ac7428ef93721 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:28.459309 32510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.455103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:44015 (local address 127.30.35.193:45771)
0807 20:17:28.455376 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:28.455378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:28.455384 (+ 6us) server_negotiation.cc:407] Connection header received
0807 20:17:28.455403 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:28.455404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:28.455412 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:28.455620 (+ 208us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:28.455650 (+ 30us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.456334 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.458171 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.458689 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.458759 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.458766 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:28.459174 (+ 408us) server_negotiation.cc:299] Negotiation successful
0807 20:17:28.459222 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":53,"threads_started":1}
I20260807 20:17:28.459496 31970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3219a87ddd124c1dbb77a5b2ad404c8c" candidate_uuid: "b030eb94d2204c3f9e54197603ec60d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "946ddb3b01ff4972ba9ac7428ef93721" is_pre_election: true
I20260807 20:17:28.459897 32181 raft_consensus.cc:2454] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9667b26c724560bc7d1c3046938a7e in term 1.
I20260807 20:17:28.459909 31971 raft_consensus.cc:2454] T 3219a87ddd124c1dbb77a5b2ad404c8c P 946ddb3b01ff4972ba9ac7428ef93721 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab9667b26c724560bc7d1c3046938a7e in term 1.
I20260807 20:17:28.460054 32283 leader_election.cc:302] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 946ddb3b01ff4972ba9ac7428ef93721, ab9667b26c724560bc7d1c3046938a7e; no voters:
I20260807 20:17:28.460131 32504 raft_consensus.cc:2781] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:28.460182 32080 leader_election.cc:302] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b030eb94d2204c3f9e54197603ec60d5; no voters: 946ddb3b01ff4972ba9ac7428ef93721, ab9667b26c724560bc7d1c3046938a7e
I20260807 20:17:28.460285 32504 raft_consensus.cc:686] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [term 1 LEADER]: Becoming Leader. State: Replica: ab9667b26c724560bc7d1c3046938a7e, State: Running, Role: LEADER
I20260807 20:17:28.460292 32505 raft_consensus.cc:2726] T 3219a87ddd124c1dbb77a5b2ad404c8c P b030eb94d2204c3f9e54197603ec60d5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 20:17:28.460374 32504 consensus_queue.cc:237] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b030eb94d2204c3f9e54197603ec60d5" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 32911 } } peers { permanent_uuid: "ab9667b26c724560bc7d1c3046938a7e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35829 } } peers { permanent_uuid: "946ddb3b01ff4972ba9ac7428ef93721" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45771 } }
I20260807 20:17:28.461246 31742 catalog_manager.cc:5495] T 3219a87ddd124c1dbb77a5b2ad404c8c P ab9667b26c724560bc7d1c3046938a7e reported cstate change: term changed from 0 to 1, leader changed from <none> to ab9667b26c724560bc7d1c3046938a7e (127.30.35.195). New cstate: current_term: 1 leader_uuid: "ab9667b26c724560bc7d1c3046938a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b030eb94d2204c3f9e54197603ec60d5" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 32911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab9667b26c724560bc7d1c3046938a7e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "946ddb3b01ff4972ba9ac7428ef93721" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45771 } health_report { overall_health: UNKNOWN } } }
Aug 07 20:17:28 dist-test-slave-t7g5 krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133847, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.193@KRBTEST.COM
I20260807 20:17:28.510847 32510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.503809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54918 (local address 127.30.35.193:45771)
0807 20:17:28.503881 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:28.503883 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:28.503892 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:28.503971 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:28.503972 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:28.503983 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:28.504030 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:28.504601 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.505070 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.505797 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.505995 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.506051 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.508244 (+ 2193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:28.508257 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:28.508257 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:28.508265 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:28.509783 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:28.510088 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:28.510092 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:28.510092 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:28.510154 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:28.510323 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:28.510323 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:28.510324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:28.510465 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:28.510613 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:28.510675 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 20:17:28.510753 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
Aug 07 20:17:28 dist-test-slave-t7g5 krb5kdc[31679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133848, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 20:17:28 dist-test-slave-t7g5 krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133848, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.35.193@KRBTEST.COM
I20260807 20:17:28.533143 32510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.526985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54928 (local address 127.30.35.193:45771)
0807 20:17:28.527039 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:28.527041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:28.527103 (+ 62us) server_negotiation.cc:407] Connection header received
0807 20:17:28.527173 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:28.527174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:28.527185 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:28.527230 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:28.527719 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.528178 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.528848 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.529029 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.529081 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.531093 (+ 2012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:28.531095 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:28.531095 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:28.531103 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:28.532090 (+ 987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:28.532450 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:28.532451 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:28.532451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:28.532504 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:28.532660 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:28.532661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:28.532661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:28.532749 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:28.532833 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:28.532988 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 20:17:28.533056 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
Aug 07 20:17:28 dist-test-slave-t7g5 krb5kdc[31679](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133848, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 20:17:28 dist-test-slave-t7g5 krb5kdc[31679](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133848, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.193@KRBTEST.COM
I20260807 20:17:28.553732 32510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:28.547635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54930 (local address 127.30.35.193:45771)
0807 20:17:28.547702 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:28.547704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:28.547758 (+ 54us) server_negotiation.cc:407] Connection header received
0807 20:17:28.547810 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:28.547811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:28.547819 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:28.547864 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:28.548309 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.548758 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.549408 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:28.549609 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:28.549698 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:28.551739 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:28.551741 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:28.551741 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:28.551748 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:28.552954 (+ 1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:28.553194 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:28.553195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:28.553195 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:28.553237 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:28.553353 (+ 116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:28.553354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:28.553354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:28.553442 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:28.553506 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:28.553574 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 20:17:28.553626 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260807 20:17:28.554214 31910 tablet_service.cc:2908] Rejecting scan request for tablet 3219a87ddd124c1dbb77a5b2ad404c8c: Uninitialized: clean time has not yet been initialized
I20260807 20:17:28.554929 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 31838
I20260807 20:17:28.566905 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 32053
I20260807 20:17:28.577306 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 32262
I20260807 20:17:28.584136 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 31699
2026-08-07T20:17:28Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2404 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:17:28 dist-test-slave-t7g5 krb5kdc[32537](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:17:28 dist-test-slave-t7g5 krb5kdc[32537](info): set up 2 sockets
Aug 07 20:17:28 dist-test-slave-t7g5 krb5kdc[32537](info): commencing operation
krb5kdc: starting...
W20260807 20:17:29.711269 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:17:29 dist-test-slave-t7g5 krb5kdc[32537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:17:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:17:29.826489 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:33331
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:36079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:33331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:29.908592 32556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:29.908814 32556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:29.908835 32556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:29.909977 32556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:29.910017 32556 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 20:17:29.910029 32556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:29.910041 32556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:29.910053 32556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:29.910063 32556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:29.911537 32556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:33331
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:33331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:29.911772 32556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:29.911986 32556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:29.916554 32567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:29.916555 32564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:29.916718 32556 server_base.cc:1034] running on GCE node
W20260807 20:17:29.916618 32565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:29.917106 32556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:29.917346 32556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:29.918479 32556 hybrid_clock.cc:648] HybridClock initialized: now 1786133849918469 us; error 28 us; skew 500 ppm
Aug 07 20:17:29 dist-test-slave-t7g5 krb5kdc[32537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133849, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:29.923565 32556 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:17:29.923982 32556 webserver.cc:460] Webserver started at http://127.30.35.254:40245/ using document root <none> and password file <none>
I20260807 20:17:29.924185 32556 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:29.924232 32556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:29.924335 32556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:29.925396 32556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "6ea2e665764b420f987c96f5f6a997b7"
format_stamp: "Formatted at 2026-08-07 20:17:29 on dist-test-slave-t7g5"
server_key: "8ed99813aa8cd6122674806cf8e8e187"
server_key_iv: "06128237c64f6dbc84710e3ced2e2974"
server_key_version: "encryptionkey@0"
I20260807 20:17:29.925776 32556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "6ea2e665764b420f987c96f5f6a997b7"
format_stamp: "Formatted at 2026-08-07 20:17:29 on dist-test-slave-t7g5"
server_key: "8ed99813aa8cd6122674806cf8e8e187"
server_key_iv: "06128237c64f6dbc84710e3ced2e2974"
server_key_version: "encryptionkey@0"
I20260807 20:17:29.927060 32556 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:29.927719 32575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:29.927860 32556 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:29.927984 32556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "6ea2e665764b420f987c96f5f6a997b7"
format_stamp: "Formatted at 2026-08-07 20:17:29 on dist-test-slave-t7g5"
server_key: "8ed99813aa8cd6122674806cf8e8e187"
server_key_iv: "06128237c64f6dbc84710e3ced2e2974"
server_key_version: "encryptionkey@0"
I20260807 20:17:29.928059 32556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:29.939200 32556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:29.941192 32556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:29.941321 32556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:29.945777 32556 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:33331
I20260807 20:17:29.945849 32687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:33331 every 8 connection(s)
I20260807 20:17:29.946147 32556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:29.946800 32688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:29.948977 32688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7: Bootstrap starting.
I20260807 20:17:29.949573 32688 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:29.949856 32688 log.cc:824] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:29.950481 32688 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7: No bootstrap required, opened a new log
I20260807 20:17:29.951773 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 32556
I20260807 20:17:29.951859 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:29.952003 30863 external_mini_cluster.cc:1428] Setting key a4f3b23980a6fc380c5eaa46d2c2cbad
I20260807 20:17:29.952975 32688 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ea2e665764b420f987c96f5f6a997b7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33331 } }
I20260807 20:17:29.953151 32688 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:29.953198 32688 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ea2e665764b420f987c96f5f6a997b7, State: Initialized, Role: FOLLOWER
I20260807 20:17:29.953315 32688 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ea2e665764b420f987c96f5f6a997b7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33331 } }
I20260807 20:17:29.953392 32688 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:29.953423 32688 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:29.953460 32688 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:29.954224 32688 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ea2e665764b420f987c96f5f6a997b7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33331 } }
I20260807 20:17:29.954341 32688 leader_election.cc:302] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ea2e665764b420f987c96f5f6a997b7; no voters:
I20260807 20:17:29.954515 32688 leader_election.cc:288] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:29.954602 32693 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:29.954802 32688 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:29.955331 32693 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [term 1 LEADER]: Becoming Leader. State: Replica: 6ea2e665764b420f987c96f5f6a997b7, State: Running, Role: LEADER
I20260807 20:17:29.955564 32693 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ea2e665764b420f987c96f5f6a997b7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33331 } }
I20260807 20:17:29.956198 32693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ea2e665764b420f987c96f5f6a997b7. Latest consensus state: current_term: 1 leader_uuid: "6ea2e665764b420f987c96f5f6a997b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ea2e665764b420f987c96f5f6a997b7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33331 } } }
I20260807 20:17:29.956408 32693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:29.956643 32695 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ea2e665764b420f987c96f5f6a997b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ea2e665764b420f987c96f5f6a997b7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33331 } } }
I20260807 20:17:29.956727 32695 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:29.956983 32717 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:29.957975 32717 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 20:17:29 dist-test-slave-t7g5 krb5kdc[32537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:29.959708 32717 catalog_manager.cc:1347] Generated new cluster ID: 0ce2da4080884204a4a63140e24223f5
I20260807 20:17:29.959761 32717 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:17:29.962404 32692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:29.952519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36006 (local address 127.30.35.254:33331)
0807 20:17:29.952734 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:29.952746 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:29.952783 (+ 37us) server_negotiation.cc:407] Connection header received
0807 20:17:29.952926 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:29.952934 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:29.952993 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:29.953140 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:29.953881 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:29.955168 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:29.956297 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:29.956916 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:29.957022 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:29.959364 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:29.959369 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:29.959369 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:29.959381 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:29.960906 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:29.961249 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:29.961252 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:29.961253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:29.961356 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:29.961544 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:29.961545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:29.961545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:29.961850 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:29.962037 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:29.962107 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 20:17:29.962241 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":102,"threads_started":1}
I20260807 20:17:29.977164 32717 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:29.977914 32717 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:29.986193 32717 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7: Generated new TSK 0
I20260807 20:17:29.986352 32717 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:17:30.020377 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33331
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:36079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:30.112452 32726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:30.112741 32726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:30.112782 32726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:30.114512 32726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:30.114574 32726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:30.114604 32726 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 20:17:30.114629 32726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:17:30.116770 32726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.35.254:33331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:30.117024 32726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:30.117260 32726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:30.123320 32739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:30.123343 32733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:30.123358 32734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:30.123816 32726 server_base.cc:1034] running on GCE node
I20260807 20:17:30.124033 32726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:30.124277 32726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:30.125415 32726 hybrid_clock.cc:648] HybridClock initialized: now 1786133850125406 us; error 36 us; skew 500 ppm
Aug 07 20:17:30 dist-test-slave-t7g5 krb5kdc[32537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133850, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:30.127910 32726 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:17:30.128317 32726 webserver.cc:460] Webserver started at http://127.30.35.193:38523/ using document root <none> and password file <none>
I20260807 20:17:30.128571 32726 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:30.128630 32726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:30.128763 32726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:30.129930 32726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "cb5df52826814b909576acbd80a12854"
format_stamp: "Formatted at 2026-08-07 20:17:30 on dist-test-slave-t7g5"
server_key: "f60bfa141e8fea4bfdba114e35895f6f"
server_key_iv: "d3c16c81812012c03c587fa372687ce9"
server_key_version: "encryptionkey@0"
I20260807 20:17:30.130288 32726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "cb5df52826814b909576acbd80a12854"
format_stamp: "Formatted at 2026-08-07 20:17:30 on dist-test-slave-t7g5"
server_key: "f60bfa141e8fea4bfdba114e35895f6f"
server_key_iv: "d3c16c81812012c03c587fa372687ce9"
server_key_version: "encryptionkey@0"
I20260807 20:17:30.131682 32726 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:30.132375 32754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:30.132532 32726 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:30.132616 32726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "cb5df52826814b909576acbd80a12854"
format_stamp: "Formatted at 2026-08-07 20:17:30 on dist-test-slave-t7g5"
server_key: "f60bfa141e8fea4bfdba114e35895f6f"
server_key_iv: "d3c16c81812012c03c587fa372687ce9"
server_key_version: "encryptionkey@0"
I20260807 20:17:30.132682 32726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:30.145248 32726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:30.147250 32726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:30.147383 32726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:30.147857 32726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:30.147897 32726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:30.147927 32726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:30.147943 32726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 20:17:30 dist-test-slave-t7g5 krb5kdc[32537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133850, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:30.155066 32726 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:45001
I20260807 20:17:30.155133 463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:45001 every 8 connection(s)
I20260807 20:17:30.155522 32726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:17:30.157979 32692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.148331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:40129 (local address 127.30.35.254:33331)
0807 20:17:30.148394 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.148397 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.148681 (+ 284us) server_negotiation.cc:407] Connection header received
0807 20:17:30.149139 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.149140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.149158 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.149223 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:30.150083 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.150587 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.151564 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.151764 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.151821 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.154967 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:30.154969 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:30.154969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:30.154977 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:30.156614 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.157010 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.157011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.157012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.157071 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.157298 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.157299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.157299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.157418 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:30.157476 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.157764 (+ 288us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.157883 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 20:17:30.158123 302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.148325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33331 (local address 127.30.35.193:40129)
0807 20:17:30.148560 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.148594 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.149050 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.149307 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.149310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.149642 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:30.149965 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.149972 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.150674 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.150676 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.151483 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.151486 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.151833 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.151834 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.151990 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.152471 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:30.152482 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:30.154840 (+ 2358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:30.156716 (+ 1876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:30.156724 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:30.156726 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:30.156940 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:30.157125 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:30.157125 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:30.157126 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:30.157241 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:30.157473 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:30.157480 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:30.157616 (+ 136us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.157739 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.157913 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":163,"threads_started":1}
I20260807 20:17:30.158579 466 heartbeater.cc:347] Connected to a master server at 127.30.35.254:33331
I20260807 20:17:30.158659 466 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:30.158823 466 heartbeater.cc:511] Master 127.30.35.254:33331 requested a full tablet report, sending...
I20260807 20:17:30.159322 32606 ts_manager.cc:194] Registered new tserver with Master: cb5df52826814b909576acbd80a12854 (127.30.35.193:45001)
I20260807 20:17:30.159953 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 32726
I20260807 20:17:30.160055 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:17:30.160032 32606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:40129
I20260807 20:17:30.160243 30863 external_mini_cluster.cc:1428] Setting key dc21d03e34a5c061d7903b641fa37545
I20260807 20:17:30.165644 474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.160393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33331 (local address 127.30.35.193:56389)
0807 20:17:30.160542 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.160553 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.160630 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.160770 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.160771 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.160966 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:30.161025 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.161027 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.161819 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.161820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.162340 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.162342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.162677 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.162678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.162751 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.163120 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:30.163124 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:30.163391 (+ 267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:30.164746 (+ 1355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:30.164747 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:30.164747 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:30.164912 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:30.165078 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:30.165079 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:30.165079 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:30.165136 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:30.165341 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:30.165342 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:30.165386 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.165446 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.165548 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":89,"threads_started":1}
I20260807 20:17:30.165640 32692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.160392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:56389 (local address 127.30.35.254:33331)
0807 20:17:30.160429 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.160431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.160605 (+ 174us) server_negotiation.cc:407] Connection header received
0807 20:17:30.160704 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.160705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.160715 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.160765 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:30.161101 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.161740 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.162418 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.162619 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.162673 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.163470 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:30.163472 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:30.163472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:30.163478 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:30.164674 (+ 1196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.164970 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.164971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.164972 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.165026 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.165184 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.165185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.165185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.165289 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:30.165343 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.165474 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.165550 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:17:30.185071 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33331
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:36079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:30.270015 478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:30.270221 478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:30.270243 478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:30.271382 478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:30.271422 478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:30.271441 478 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 20:17:30.271459 478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:17:30.272823 478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.35.254:33331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:30.273017 478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:30.273200 478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:30.277894 491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:30.277910 493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:30.277910 495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:30.278112 478 server_base.cc:1034] running on GCE node
I20260807 20:17:30.278302 478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:30.278512 478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:30.279645 478 hybrid_clock.cc:648] HybridClock initialized: now 1786133850279634 us; error 30 us; skew 500 ppm
Aug 07 20:17:30 dist-test-slave-t7g5 krb5kdc[32537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133850, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:30.282078 478 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:17:30.282497 478 webserver.cc:460] Webserver started at http://127.30.35.194:42139/ using document root <none> and password file <none>
I20260807 20:17:30.282691 478 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:30.282738 478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:30.282864 478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:30.283854 478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "32cb7c5df4e644a193730bdc33cd4864"
format_stamp: "Formatted at 2026-08-07 20:17:30 on dist-test-slave-t7g5"
server_key: "eed9726fe0369da23b401154e8e5429f"
server_key_iv: "fd0d7a0b7509e19b6fc58238210825ff"
server_key_version: "encryptionkey@0"
I20260807 20:17:30.284189 478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "32cb7c5df4e644a193730bdc33cd4864"
format_stamp: "Formatted at 2026-08-07 20:17:30 on dist-test-slave-t7g5"
server_key: "eed9726fe0369da23b401154e8e5429f"
server_key_iv: "fd0d7a0b7509e19b6fc58238210825ff"
server_key_version: "encryptionkey@0"
I20260807 20:17:30.285373 478 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:30.286046 507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:30.286193 478 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:30.286274 478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "32cb7c5df4e644a193730bdc33cd4864"
format_stamp: "Formatted at 2026-08-07 20:17:30 on dist-test-slave-t7g5"
server_key: "eed9726fe0369da23b401154e8e5429f"
server_key_iv: "fd0d7a0b7509e19b6fc58238210825ff"
server_key_version: "encryptionkey@0"
I20260807 20:17:30.286338 478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:30.301558 478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:30.303661 478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:30.303802 478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:30.304334 478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:30.304376 478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:30.304407 478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:30.304425 478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 20:17:30 dist-test-slave-t7g5 krb5kdc[32537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133850, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:30.311259 478 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:41675
I20260807 20:17:30.311426 671 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:41675 every 8 connection(s)
I20260807 20:17:30.311656 478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:17:30.313514 32692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.304767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:38763 (local address 127.30.35.254:33331)
0807 20:17:30.304810 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.304813 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.305037 (+ 224us) server_negotiation.cc:407] Connection header received
0807 20:17:30.305553 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.305555 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.305568 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.305624 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:30.306325 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.306832 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.307826 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.308018 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.308074 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.310879 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:30.310880 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:30.310881 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:30.310888 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:30.312413 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.312762 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.312763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.312763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.312821 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.313001 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.313002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.313002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.313100 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:30.313141 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.313373 (+ 232us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.313449 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:17:30.313633 520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.304762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33331 (local address 127.30.35.194:38763)
0807 20:17:30.304916 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.304953 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.305450 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.305729 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.305734 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.306014 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:30.306232 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.306239 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.306921 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.306922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.307743 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.307746 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.308088 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.308089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.308217 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.308694 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:30.308703 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:30.310769 (+ 2066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:30.312481 (+ 1712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:30.312484 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:30.312486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:30.312698 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:30.312873 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:30.312873 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:30.312873 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:30.312965 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:30.313133 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:30.313136 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:30.313247 (+ 111us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.313324 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.313456 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":83,"threads_started":1}
I20260807 20:17:30.314137 672 heartbeater.cc:347] Connected to a master server at 127.30.35.254:33331
I20260807 20:17:30.314224 672 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:30.314399 672 heartbeater.cc:511] Master 127.30.35.254:33331 requested a full tablet report, sending...
I20260807 20:17:30.314800 32604 ts_manager.cc:194] Registered new tserver with Master: 32cb7c5df4e644a193730bdc33cd4864 (127.30.35.194:41675)
I20260807 20:17:30.315271 32604 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:38763
I20260807 20:17:30.319818 32692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.315155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:40795 (local address 127.30.35.254:33331)
0807 20:17:30.315198 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.315200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.315306 (+ 106us) server_negotiation.cc:407] Connection header received
0807 20:17:30.315362 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.315363 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.315372 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.315424 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:30.315769 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.316221 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.316859 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.317030 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.317071 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.317968 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:30.317969 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:30.317969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:30.317975 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:30.318995 (+ 1020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.319266 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.319266 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.319267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.319308 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.319435 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.319435 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.319435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.319558 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:30.319603 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.319698 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.319755 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 20:17:30.319823 682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.315091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33331 (local address 127.30.35.194:40795)
0807 20:17:30.315244 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.315254 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.315308 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.315429 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.315430 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.315626 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:30.315694 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.315696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.316303 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.316304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.316798 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.316800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.317106 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.317107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.317181 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.317554 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:30.317558 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:30.317889 (+ 331us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:30.319047 (+ 1158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:30.319048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:30.319049 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:30.319203 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:30.319353 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:30.319354 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:30.319354 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:30.319402 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:30.319598 (+ 196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:30.319599 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:30.319634 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.319675 (+ 41us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.319757 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":5,"thread_start_us":78,"threads_started":1}
I20260807 20:17:30.321910 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 478
I20260807 20:17:30.322003 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:17:30.322140 30863 external_mini_cluster.cc:1428] Setting key c4f35845ca1cb788116a3b7ec2cf68b5
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:17:30.346643 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33331
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:36079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:30.427454 689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:30.427659 689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:30.427682 689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:30.428797 689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:30.428836 689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:30.428855 689 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 20:17:30.428884 689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:17:30.430312 689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.35.254:33331
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:30.430540 689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:30.430754 689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:30.435369 695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:30.435423 698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:30.435575 689 server_base.cc:1034] running on GCE node
W20260807 20:17:30.435580 696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:30.435804 689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:30.436049 689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:30.437180 689 hybrid_clock.cc:648] HybridClock initialized: now 1786133850437168 us; error 25 us; skew 500 ppm
Aug 07 20:17:30 dist-test-slave-t7g5 krb5kdc[32537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133850, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:30.439582 689 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:17:30.439999 689 webserver.cc:460] Webserver started at http://127.30.35.195:43685/ using document root <none> and password file <none>
I20260807 20:17:30.440191 689 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:30.440237 689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:30.440369 689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:30.441390 689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "c3e03e0bc9154e379f7d59ad632ce26e"
format_stamp: "Formatted at 2026-08-07 20:17:30 on dist-test-slave-t7g5"
server_key: "414a99a137bd5cf56077a9d08e06b92f"
server_key_iv: "54ccf74459d528df9616ca69b96dd7c7"
server_key_version: "encryptionkey@0"
I20260807 20:17:30.441758 689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "c3e03e0bc9154e379f7d59ad632ce26e"
format_stamp: "Formatted at 2026-08-07 20:17:30 on dist-test-slave-t7g5"
server_key: "414a99a137bd5cf56077a9d08e06b92f"
server_key_iv: "54ccf74459d528df9616ca69b96dd7c7"
server_key_version: "encryptionkey@0"
I20260807 20:17:30.442955 689 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:30.443631 712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:30.443784 689 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:30.443871 689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "c3e03e0bc9154e379f7d59ad632ce26e"
format_stamp: "Formatted at 2026-08-07 20:17:30 on dist-test-slave-t7g5"
server_key: "414a99a137bd5cf56077a9d08e06b92f"
server_key_iv: "54ccf74459d528df9616ca69b96dd7c7"
server_key_version: "encryptionkey@0"
I20260807 20:17:30.443931 689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:30.455624 689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:30.457818 689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:30.457958 689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:30.458477 689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:30.458520 689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:30.458547 689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:30.458563 689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 20:17:30 dist-test-slave-t7g5 krb5kdc[32537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133850, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:30.465049 689 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:38101
I20260807 20:17:30.465107 908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:38101 every 8 connection(s)
I20260807 20:17:30.465457 689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:17:30.467599 32692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.458772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:60969 (local address 127.30.35.254:33331)
0807 20:17:30.458811 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.458813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.459065 (+ 252us) server_negotiation.cc:407] Connection header received
0807 20:17:30.459534 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.459535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.459549 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.459623 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:30.460236 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.460986 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.462206 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.462465 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.462535 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.465178 (+ 2643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:30.465180 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:30.465180 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:30.465188 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:30.466578 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.466932 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.466932 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.466933 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.466980 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.467139 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.467139 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.467140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.467234 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:30.467277 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.467476 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.467536 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 20:17:30.467772 726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.458791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33331 (local address 127.30.35.195:60969)
0807 20:17:30.458958 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.458993 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.459442 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.459683 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.459687 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.459955 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:30.460162 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.460167 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.461078 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.461079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.462123 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.462126 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.462554 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.462555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.462676 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.463110 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:30.463120 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:30.465072 (+ 1952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:30.466641 (+ 1569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:30.466644 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:30.466646 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:30.466847 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:30.467015 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:30.467016 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:30.467016 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:30.467100 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:30.467275 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:30.467278 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:30.467386 (+ 108us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.467462 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.467577 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":80,"threads_started":1}
I20260807 20:17:30.468190 910 heartbeater.cc:347] Connected to a master server at 127.30.35.254:33331
I20260807 20:17:30.468266 910 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:30.468442 910 heartbeater.cc:511] Master 127.30.35.254:33331 requested a full tablet report, sending...
I20260807 20:17:30.468796 32604 ts_manager.cc:194] Registered new tserver with Master: c3e03e0bc9154e379f7d59ad632ce26e (127.30.35.195:38101)
I20260807 20:17:30.469172 32604 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:60969
I20260807 20:17:30.471745 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 689
I20260807 20:17:30.471828 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:17:30.471987 30863 external_mini_cluster.cc:1428] Setting key 6b60b38b1d9776df4a5d83faa42c9305
I20260807 20:17:30.472705 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:17:30.474185 924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.469082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33331 (local address 127.30.35.195:40383)
0807 20:17:30.469198 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.469207 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.469281 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.469390 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.469391 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.469558 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:30.469616 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.469617 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.470238 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.470239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.470755 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.470757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.471075 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.471076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.471151 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.471460 (+ 309us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:30.471463 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:30.471713 (+ 250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:30.473306 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:30.473307 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:30.473308 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:30.473474 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:30.473680 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:30.473681 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:30.473681 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:30.473741 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:30.473968 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:30.473969 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:30.474003 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.474046 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.474117 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":70,"threads_started":1}
I20260807 20:17:30.474215 32692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.469151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:40383 (local address 127.30.35.254:33331)
0807 20:17:30.469191 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.469193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.469256 (+ 63us) server_negotiation.cc:407] Connection header received
0807 20:17:30.469336 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.469337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.469347 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.469387 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:30.469694 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.470154 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.470823 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.471019 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.471072 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.471789 (+ 717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:30.471790 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:30.471790 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:30.471796 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:30.473236 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.473536 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.473538 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.473538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.473599 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.473793 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.473794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.473794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.473916 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:30.473979 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.474069 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.474136 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 07 20:17:30 dist-test-slave-t7g5 krb5kdc[32537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133850, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 20:17:30 dist-test-slave-t7g5 krb5kdc[32537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133850, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:30.495473 32692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.489257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36018 (local address 127.30.35.254:33331)
0807 20:17:30.489317 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.489319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.489328 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:30.489354 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.489354 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.489363 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.489408 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:30.490046 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.490534 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.491253 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.491443 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.491499 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.493560 (+ 2061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:30.493561 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:30.493562 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:30.493569 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:30.494622 (+ 1053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.494929 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.494929 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.494930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.494973 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.495097 (+ 124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.495098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.495098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.495188 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:30.495256 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.495325 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.495382 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 20:17:30.497001 32604 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36018:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:17:30.498642 32604 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:30.505119 944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.501179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36886 (local address 127.30.35.195:38101)
0807 20:17:30.501607 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.501611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.501620 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:30.501692 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.501695 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.501710 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.501779 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:30.501967 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.502951 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.504012 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.504732 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.504798 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.504864 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.504985 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.505027 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":91,"threads_started":1}
I20260807 20:17:30.505095 943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.500973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:38101 (local address 127.0.0.1:36886)
0807 20:17:30.501181 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.501190 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.501237 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.501848 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.501849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.501851 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:30.501887 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.501888 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.503018 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.503019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.503924 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.503926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.504806 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.504807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.504884 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.504898 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.504961 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.505014 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":1,"thread_start_us":72,"threads_started":1}
I20260807 20:17:30.505280 942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.500947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59116 (local address 127.30.35.193:45001)
0807 20:17:30.501139 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.501143 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.501153 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:17:30.501194 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.501196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.501213 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.501286 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:30.501774 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.502536 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.503912 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.504737 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.504808 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.504875 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.505134 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.505177 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":79,"threads_started":1}
I20260807 20:17:30.505343 940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.500737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:45001 (local address 127.0.0.1:59116)
0807 20:17:30.500881 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.500926 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.500989 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.501364 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.501367 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.501368 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:30.501466 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.501468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.502607 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.502607 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.503812 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.503815 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.504906 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.504907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.504974 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.504978 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.505026 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.505066 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":2,"thread_start_us":61,"threads_started":1}
I20260807 20:17:30.505636 939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.500752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:41675 (local address 127.0.0.1:49778)
0807 20:17:30.501109 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.501120 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.501202 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.501432 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.501433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.501435 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:30.501471 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.501472 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.502840 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.502841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.504010 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.504012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.504902 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.504903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.504983 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.504986 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.505026 (+ 40us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.505066 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":36,"thread_start_us":77,"threads_started":1}
I20260807 20:17:30.505890 941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.500872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49778 (local address 127.30.35.194:41675)
0807 20:17:30.501061 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.501066 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.501177 (+ 111us) server_negotiation.cc:407] Connection header received
0807 20:17:30.501289 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.501291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.501304 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.501352 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:30.501594 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.502756 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.504074 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.504740 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.504808 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.504863 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.505111 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.505152 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":85,"threads_started":1}
I20260807 20:17:30.505885 789 tablet_service.cc:1467] Processing CreateTablet for tablet efa9d7ebe9ef424c997905652684f576 (DEFAULT_TABLE table=test-table [id=3428dcd8e8534c3eb69b5665194a889e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:30.506058 367 tablet_service.cc:1467] Processing CreateTablet for tablet efa9d7ebe9ef424c997905652684f576 (DEFAULT_TABLE table=test-table [id=3428dcd8e8534c3eb69b5665194a889e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:30.506232 789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa9d7ebe9ef424c997905652684f576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:30.506412 367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa9d7ebe9ef424c997905652684f576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:30.506479 578 tablet_service.cc:1467] Processing CreateTablet for tablet efa9d7ebe9ef424c997905652684f576 (DEFAULT_TABLE table=test-table [id=3428dcd8e8534c3eb69b5665194a889e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:30.506774 578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efa9d7ebe9ef424c997905652684f576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:30.508643 946 tablet_bootstrap.cc:492] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e: Bootstrap starting.
I20260807 20:17:30.509424 946 tablet_bootstrap.cc:654] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:30.509696 946 log.cc:824] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:30.510093 950 tablet_bootstrap.cc:492] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864: Bootstrap starting.
I20260807 20:17:30.510396 947 tablet_bootstrap.cc:492] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854: Bootstrap starting.
I20260807 20:17:30.510663 950 tablet_bootstrap.cc:654] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:30.510893 947 tablet_bootstrap.cc:654] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:30.510921 950 log.cc:824] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:30.511193 947 log.cc:824] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:30.511658 950 tablet_bootstrap.cc:492] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864: No bootstrap required, opened a new log
I20260807 20:17:30.511729 950 ts_tablet_manager.cc:1397] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:30.511909 947 tablet_bootstrap.cc:492] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854: No bootstrap required, opened a new log
I20260807 20:17:30.511973 947 ts_tablet_manager.cc:1397] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:30.513130 950 raft_consensus.cc:348] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.513263 950 raft_consensus.cc:374] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:30.513296 950 raft_consensus.cc:729] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32cb7c5df4e644a193730bdc33cd4864, State: Initialized, Role: FOLLOWER
I20260807 20:17:30.513260 947 raft_consensus.cc:348] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.513403 947 raft_consensus.cc:374] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:30.513437 947 raft_consensus.cc:729] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb5df52826814b909576acbd80a12854, State: Initialized, Role: FOLLOWER
I20260807 20:17:30.513411 950 consensus_queue.cc:260] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.513530 947 consensus_queue.cc:260] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.513701 950 ts_tablet_manager.cc:1428] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:17:30.513727 672 heartbeater.cc:503] Master 127.30.35.254:33331 was elected leader, sending a full tablet report...
I20260807 20:17:30.513818 947 ts_tablet_manager.cc:1428] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:17:30.513913 466 heartbeater.cc:503] Master 127.30.35.254:33331 was elected leader, sending a full tablet report...
I20260807 20:17:30.514247 946 tablet_bootstrap.cc:492] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e: No bootstrap required, opened a new log
I20260807 20:17:30.514321 946 ts_tablet_manager.cc:1397] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260807 20:17:30.515946 946 raft_consensus.cc:348] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.516069 946 raft_consensus.cc:374] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:30.516089 946 raft_consensus.cc:729] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e03e0bc9154e379f7d59ad632ce26e, State: Initialized, Role: FOLLOWER
I20260807 20:17:30.516168 946 consensus_queue.cc:260] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.516352 946 ts_tablet_manager.cc:1428] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:17:30.516415 910 heartbeater.cc:503] Master 127.30.35.254:33331 was elected leader, sending a full tablet report...
I20260807 20:17:30.535808 958 raft_consensus.cc:482] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:30.535912 958 raft_consensus.cc:504] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.536222 958 leader_election.cc:288] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32cb7c5df4e644a193730bdc33cd4864 (127.30.35.194:41675), c3e03e0bc9154e379f7d59ad632ce26e (127.30.35.195:38101)
I20260807 20:17:30.538847 941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.536458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:40219 (local address 127.30.35.194:41675)
0807 20:17:30.536506 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.536508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.536517 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:30.536544 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.536545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.536553 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.536605 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:30.536735 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.537201 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.538113 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.538501 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.538558 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.538568 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.538747 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.538784 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 20:17:30.538847 302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.536364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:41675 (local address 127.30.35.193:40219)
0807 20:17:30.536412 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.536424 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.536473 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.536619 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.536620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.536622 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:30.536680 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.536682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.537270 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.537271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.538030 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.538033 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.538599 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.538600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.538682 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.538687 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.538739 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.538777 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260807 20:17:30.539175 962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.536456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:38101 (local address 127.30.35.193:42727)
0807 20:17:30.536620 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.536628 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.536677 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.536788 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.536789 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.536790 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:30.536864 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.536865 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.537433 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.537434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.538201 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.538204 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.538896 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.538897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.538980 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.538985 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.539058 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.539091 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":111,"threads_started":1}
I20260807 20:17:30.539177 944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.536560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:42727 (local address 127.30.35.195:38101)
0807 20:17:30.536603 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.536605 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.536679 (+ 74us) server_negotiation.cc:407] Connection header received
0807 20:17:30.536724 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.536725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.536733 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.536784 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:30.536918 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.537368 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.538281 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.538804 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.538858 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.538876 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.539078 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.539122 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:17:30.539178 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa9d7ebe9ef424c997905652684f576" candidate_uuid: "cb5df52826814b909576acbd80a12854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32cb7c5df4e644a193730bdc33cd4864" is_pre_election: true
I20260807 20:17:30.539311 607 raft_consensus.cc:2454] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb5df52826814b909576acbd80a12854 in term 0.
I20260807 20:17:30.539541 32761 leader_election.cc:302] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32cb7c5df4e644a193730bdc33cd4864, cb5df52826814b909576acbd80a12854; no voters:
I20260807 20:17:30.539634 831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa9d7ebe9ef424c997905652684f576" candidate_uuid: "cb5df52826814b909576acbd80a12854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" is_pre_election: true
I20260807 20:17:30.539670 958 raft_consensus.cc:2781] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:30.539731 958 raft_consensus.cc:482] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:30.539762 958 raft_consensus.cc:3037] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:30.539753 831 raft_consensus.cc:2454] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb5df52826814b909576acbd80a12854 in term 0.
I20260807 20:17:30.540693 958 raft_consensus.cc:504] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.540807 958 leader_election.cc:288] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [CANDIDATE]: Term 1 election: Requested vote from peers 32cb7c5df4e644a193730bdc33cd4864 (127.30.35.194:41675), c3e03e0bc9154e379f7d59ad632ce26e (127.30.35.195:38101)
I20260807 20:17:30.540954 831 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa9d7ebe9ef424c997905652684f576" candidate_uuid: "cb5df52826814b909576acbd80a12854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e03e0bc9154e379f7d59ad632ce26e"
I20260807 20:17:30.540964 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efa9d7ebe9ef424c997905652684f576" candidate_uuid: "cb5df52826814b909576acbd80a12854" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32cb7c5df4e644a193730bdc33cd4864"
I20260807 20:17:30.541028 607 raft_consensus.cc:3037] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:30.541029 831 raft_consensus.cc:3037] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:30.541687 831 raft_consensus.cc:2454] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb5df52826814b909576acbd80a12854 in term 1.
I20260807 20:17:30.541738 607 raft_consensus.cc:2454] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb5df52826814b909576acbd80a12854 in term 1.
I20260807 20:17:30.541854 32761 leader_election.cc:302] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3e03e0bc9154e379f7d59ad632ce26e, cb5df52826814b909576acbd80a12854; no voters:
I20260807 20:17:30.541975 958 raft_consensus.cc:2781] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:30.542114 958 raft_consensus.cc:686] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [term 1 LEADER]: Becoming Leader. State: Replica: cb5df52826814b909576acbd80a12854, State: Running, Role: LEADER
I20260807 20:17:30.542194 958 consensus_queue.cc:237] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.542920 32604 catalog_manager.cc:5495] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 reported cstate change: term changed from 0 to 1, leader changed from <none> to cb5df52826814b909576acbd80a12854 (127.30.35.193). New cstate: current_term: 1 leader_uuid: "cb5df52826814b909576acbd80a12854" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } health_report { overall_health: UNKNOWN } } }
I20260807 20:17:30.552489 942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.550563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59122 (local address 127.30.35.193:45001)
0807 20:17:30.550612 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.550614 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.550621 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:17:30.550650 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.550651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.550665 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.550719 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:30.550820 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.551255 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.551922 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.552086 (+ 164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.552125 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.552261 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:30.552343 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:30.552394 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.552421 (+ 27us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.552436 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 20:17:30.554108 831 raft_consensus.cc:1261] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e [term 1 FOLLOWER]: Refusing update from remote peer cb5df52826814b909576acbd80a12854: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:30.554368 958 consensus_queue.cc:1035] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:30.556625 970 mvcc.cc:205] Tried to move back new op lower bound from 7316004251866992640 to 7316004251821400064. Current Snapshot: MvccSnapshot[applied={T|T < 7316004251866992640}]
I20260807 20:17:30.556792 607 raft_consensus.cc:1261] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864 [term 1 FOLLOWER]: Refusing update from remote peer cb5df52826814b909576acbd80a12854: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:30.557044 972 consensus_queue.cc:1035] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:30.560387 32604 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:30.560497 32604 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:30.561264 32604 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7: Sending DeleteTablet for 3 replicas of tablet efa9d7ebe9ef424c997905652684f576
I20260807 20:17:30.561707 578 tablet_service.cc:1514] Processing DeleteTablet for tablet efa9d7ebe9ef424c997905652684f576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:30 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:49778
I20260807 20:17:30.561717 789 tablet_service.cc:1514] Processing DeleteTablet for tablet efa9d7ebe9ef424c997905652684f576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:30 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:36886
I20260807 20:17:30.561996 982 tablet_replica.cc:330] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e: stopping tablet replica
I20260807 20:17:30.562000 367 tablet_service.cc:1514] Processing DeleteTablet for tablet efa9d7ebe9ef424c997905652684f576 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:30 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:59116
I20260807 20:17:30.562105 982 raft_consensus.cc:2229] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:30.562227 982 raft_consensus.cc:2258] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:30.562305 980 tablet_replica.cc:330] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864: stopping tablet replica
I20260807 20:17:30.562294 32604 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36018:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 20:17:30.562386 980 raft_consensus.cc:2229] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260807 20:17:30.562441 32604 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:30.562494 980 raft_consensus.cc:2258] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:30.562645 983 tablet_replica.cc:330] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854: stopping tablet replica
I20260807 20:17:30.562701 982 ts_tablet_manager.cc:1905] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:30.562721 983 raft_consensus.cc:2229] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:17:30.562827 983 raft_consensus.cc:2258] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:30.563879 578 tablet_service.cc:1467] Processing CreateTablet for tablet 74d1466e541b414ca4b68b6512621a75 (DEFAULT_TABLE table=test-table [id=68fa5e64b6a14a3e9b458aa8dcfa1934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:30.563894 983 ts_tablet_manager.cc:1905] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:30.563999 578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74d1466e541b414ca4b68b6512621a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:30.564742 982 ts_tablet_manager.cc:1918] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:30.564806 982 log.cc:1196] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/efa9d7ebe9ef424c997905652684f576
I20260807 20:17:30.565068 982 ts_tablet_manager.cc:1939] T efa9d7ebe9ef424c997905652684f576 P c3e03e0bc9154e379f7d59ad632ce26e: Deleting consensus metadata
I20260807 20:17:30.565272 950 tablet_bootstrap.cc:492] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864: Bootstrap starting.
I20260807 20:17:30.565541 983 ts_tablet_manager.cc:1918] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:30.565478 32583 catalog_manager.cc:4841] TS c3e03e0bc9154e379f7d59ad632ce26e (127.30.35.195:38101): tablet efa9d7ebe9ef424c997905652684f576 (table test-table [id=3428dcd8e8534c3eb69b5665194a889e]) successfully deleted
I20260807 20:17:30.565601 983 log.cc:1196] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/wal/wals/efa9d7ebe9ef424c997905652684f576
I20260807 20:17:30.565848 983 ts_tablet_manager.cc:1939] T efa9d7ebe9ef424c997905652684f576 P cb5df52826814b909576acbd80a12854: Deleting consensus metadata
I20260807 20:17:30.565922 950 tablet_bootstrap.cc:654] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:30.566340 32582 catalog_manager.cc:4841] TS cb5df52826814b909576acbd80a12854 (127.30.35.193:45001): tablet efa9d7ebe9ef424c997905652684f576 (table test-table [id=3428dcd8e8534c3eb69b5665194a889e]) successfully deleted
I20260807 20:17:30.566398 367 tablet_service.cc:1467] Processing CreateTablet for tablet 74d1466e541b414ca4b68b6512621a75 (DEFAULT_TABLE table=test-table [id=68fa5e64b6a14a3e9b458aa8dcfa1934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:30.566488 367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74d1466e541b414ca4b68b6512621a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:30.566495 950 tablet_bootstrap.cc:492] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864: No bootstrap required, opened a new log
I20260807 20:17:30.566532 950 ts_tablet_manager.cc:1397] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 20:17:30.566668 950 raft_consensus.cc:348] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.566746 950 raft_consensus.cc:374] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:30.566763 950 raft_consensus.cc:729] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32cb7c5df4e644a193730bdc33cd4864, State: Initialized, Role: FOLLOWER
I20260807 20:17:30.566802 950 consensus_queue.cc:260] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.566881 950 ts_tablet_manager.cc:1428] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:30.566887 789 tablet_service.cc:1467] Processing CreateTablet for tablet 74d1466e541b414ca4b68b6512621a75 (DEFAULT_TABLE table=test-table [id=68fa5e64b6a14a3e9b458aa8dcfa1934]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:30.566985 789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74d1466e541b414ca4b68b6512621a75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:30.567493 947 tablet_bootstrap.cc:492] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854: Bootstrap starting.
I20260807 20:17:30.567870 947 tablet_bootstrap.cc:654] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:30.568126 946 tablet_bootstrap.cc:492] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e: Bootstrap starting.
I20260807 20:17:30.568486 946 tablet_bootstrap.cc:654] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:30.568792 980 ts_tablet_manager.cc:1905] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:30.569140 946 tablet_bootstrap.cc:492] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e: No bootstrap required, opened a new log
I20260807 20:17:30.569192 946 ts_tablet_manager.cc:1397] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:30.569322 946 raft_consensus.cc:348] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.569389 946 raft_consensus.cc:374] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:30.569409 946 raft_consensus.cc:729] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e03e0bc9154e379f7d59ad632ce26e, State: Initialized, Role: FOLLOWER
I20260807 20:17:30.569453 946 consensus_queue.cc:260] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.569554 946 ts_tablet_manager.cc:1428] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:30.569949 947 tablet_bootstrap.cc:492] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854: No bootstrap required, opened a new log
I20260807 20:17:30.569998 947 ts_tablet_manager.cc:1397] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 20:17:30.570133 947 raft_consensus.cc:348] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.570189 947 raft_consensus.cc:374] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:30.570206 947 raft_consensus.cc:729] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb5df52826814b909576acbd80a12854, State: Initialized, Role: FOLLOWER
I20260807 20:17:30.570250 947 consensus_queue.cc:260] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.570325 947 ts_tablet_manager.cc:1428] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:30.570463 980 ts_tablet_manager.cc:1918] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:30.570535 980 log.cc:1196] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/efa9d7ebe9ef424c997905652684f576
I20260807 20:17:30.570777 980 ts_tablet_manager.cc:1939] T efa9d7ebe9ef424c997905652684f576 P 32cb7c5df4e644a193730bdc33cd4864: Deleting consensus metadata
I20260807 20:17:30.571128 32583 catalog_manager.cc:4841] TS 32cb7c5df4e644a193730bdc33cd4864 (127.30.35.194:41675): tablet efa9d7ebe9ef424c997905652684f576 (table test-table [id=3428dcd8e8534c3eb69b5665194a889e]) successfully deleted
I20260807 20:17:30.603909 959 raft_consensus.cc:482] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:30.604027 959 raft_consensus.cc:504] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.604393 959 leader_election.cc:288] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb5df52826814b909576acbd80a12854 (127.30.35.193:45001), 32cb7c5df4e644a193730bdc33cd4864 (127.30.35.194:41675)
I20260807 20:17:30.608001 941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.604624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:52289 (local address 127.30.35.194:41675)
0807 20:17:30.604671 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.604673 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.604858 (+ 185us) server_negotiation.cc:407] Connection header received
0807 20:17:30.604953 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.604954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.604962 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.605007 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:30.605170 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.605646 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.607106 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.607671 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.607749 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.607759 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.607884 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.607940 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 20:17:30.608019 988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.604534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:41675 (local address 127.30.35.195:52289)
0807 20:17:30.604804 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.604812 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.604881 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.605015 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.605016 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.605018 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:30.605099 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.605100 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.605750 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.605750 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.607030 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.607032 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.607758 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.607759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.607817 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.607820 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.607864 (+ 44us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.607904 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":193,"thread_start_us":61,"threads_started":1}
I20260807 20:17:30.608494 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74d1466e541b414ca4b68b6512621a75" candidate_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32cb7c5df4e644a193730bdc33cd4864" is_pre_election: true
I20260807 20:17:30.608601 607 raft_consensus.cc:2454] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3e03e0bc9154e379f7d59ad632ce26e in term 0.
I20260807 20:17:30.608693 726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.604530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:45001 (local address 127.30.35.195:36369)
0807 20:17:30.604650 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.604661 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.604708 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.604837 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.604839 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.604841 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:30.604910 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.604912 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.605870 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.605870 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.607016 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.607019 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.608454 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.608455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.608539 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.608542 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.608595 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.608634 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":6}
I20260807 20:17:30.608716 942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.604605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:36369 (local address 127.30.35.193:45001)
0807 20:17:30.604692 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.604695 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.604703 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:30.604766 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.604767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.604777 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.604828 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:30.605002 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.605787 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.607795 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.608379 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.608454 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.608461 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.608610 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.608646 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 20:17:30.609005 395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74d1466e541b414ca4b68b6512621a75" candidate_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb5df52826814b909576acbd80a12854" is_pre_election: true
I20260807 20:17:30.609037 717 leader_election.cc:302] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32cb7c5df4e644a193730bdc33cd4864, c3e03e0bc9154e379f7d59ad632ce26e; no voters:
I20260807 20:17:30.609131 395 raft_consensus.cc:2454] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3e03e0bc9154e379f7d59ad632ce26e in term 0.
I20260807 20:17:30.609158 959 raft_consensus.cc:2781] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:30.609186 959 raft_consensus.cc:482] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:30.609208 959 raft_consensus.cc:3037] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:30.609929 959 raft_consensus.cc:504] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.610052 959 leader_election.cc:288] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [CANDIDATE]: Term 1 election: Requested vote from peers cb5df52826814b909576acbd80a12854 (127.30.35.193:45001), 32cb7c5df4e644a193730bdc33cd4864 (127.30.35.194:41675)
I20260807 20:17:30.610184 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74d1466e541b414ca4b68b6512621a75" candidate_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32cb7c5df4e644a193730bdc33cd4864"
I20260807 20:17:30.610196 395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74d1466e541b414ca4b68b6512621a75" candidate_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb5df52826814b909576acbd80a12854"
I20260807 20:17:30.610245 607 raft_consensus.cc:3037] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:30.610270 395 raft_consensus.cc:3037] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:30.610821 607 raft_consensus.cc:2454] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3e03e0bc9154e379f7d59ad632ce26e in term 1.
I20260807 20:17:30.610981 717 leader_election.cc:302] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32cb7c5df4e644a193730bdc33cd4864, c3e03e0bc9154e379f7d59ad632ce26e; no voters:
I20260807 20:17:30.611011 395 raft_consensus.cc:2454] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3e03e0bc9154e379f7d59ad632ce26e in term 1.
I20260807 20:17:30.611061 959 raft_consensus.cc:2781] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:30.611196 959 raft_consensus.cc:686] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [term 1 LEADER]: Becoming Leader. State: Replica: c3e03e0bc9154e379f7d59ad632ce26e, State: Running, Role: LEADER
I20260807 20:17:30.611279 959 consensus_queue.cc:237] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.611919 32604 catalog_manager.cc:5495] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3e03e0bc9154e379f7d59ad632ce26e (127.30.35.195). New cstate: current_term: 1 leader_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } health_report { overall_health: HEALTHY } } }
Aug 07 20:17:30 dist-test-slave-t7g5 krb5kdc[32537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133849, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:30.645069 1005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.638299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33331 (local address 127.0.0.1:36024)
0807 20:17:30.638455 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.638463 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.638524 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.638636 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.638636 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.638942 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:30.638987 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.638989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.639611 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.639612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.640124 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.640125 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.640437 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.640438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.640485 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.640949 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:30.640953 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:30.642409 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:30.644124 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:30.644130 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:30.644132 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:30.644317 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:30.644525 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:30.644525 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:30.644526 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:30.644575 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:30.644812 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:30.644817 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:30.644857 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.644900 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.644989 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":94,"threads_started":1}
I20260807 20:17:30.645268 32692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.638329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36024 (local address 127.30.35.254:33331)
0807 20:17:30.638375 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.638377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.638516 (+ 139us) server_negotiation.cc:407] Connection header received
0807 20:17:30.638571 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.638571 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.638582 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.638628 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:30.639055 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.639545 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.640185 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.640376 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.640439 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.642495 (+ 2056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:30.642496 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:30.642497 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:30.642503 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:30.644043 (+ 1540us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.644383 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.644384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.644385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.644467 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.644623 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.644624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.644625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.644760 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:30.644827 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.644937 (+ 110us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.645052 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":22}
I20260807 20:17:30.647274 32604 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:36024:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 20:17:30.647573 32604 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:30.648952 367 tablet_service.cc:1467] Processing CreateTablet for tablet e7e99b8b60d4465f8afd80e8e4b0102d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0f452c01bb9f45ef9c0c31829652a566]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 20:17:30.648954 578 tablet_service.cc:1467] Processing CreateTablet for tablet e7e99b8b60d4465f8afd80e8e4b0102d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0f452c01bb9f45ef9c0c31829652a566]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 20:17:30.649116 367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7e99b8b60d4465f8afd80e8e4b0102d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:30.649120 578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7e99b8b60d4465f8afd80e8e4b0102d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:30.649791 789 tablet_service.cc:1467] Processing CreateTablet for tablet e7e99b8b60d4465f8afd80e8e4b0102d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0f452c01bb9f45ef9c0c31829652a566]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 20:17:30.649940 789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7e99b8b60d4465f8afd80e8e4b0102d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:30.650595 947 tablet_bootstrap.cc:492] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854: Bootstrap starting.
I20260807 20:17:30.651081 947 tablet_bootstrap.cc:654] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:30.652531 946 tablet_bootstrap.cc:492] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e: Bootstrap starting.
I20260807 20:17:30.652878 946 tablet_bootstrap.cc:654] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:30.653437 946 tablet_bootstrap.cc:492] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e: No bootstrap required, opened a new log
I20260807 20:17:30.653481 946 ts_tablet_manager.cc:1397] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:30.653625 950 tablet_bootstrap.cc:492] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864: Bootstrap starting.
I20260807 20:17:30.653644 946 raft_consensus.cc:348] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.653730 946 raft_consensus.cc:374] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:30.653748 946 raft_consensus.cc:729] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e03e0bc9154e379f7d59ad632ce26e, State: Initialized, Role: FOLLOWER
I20260807 20:17:30.653789 946 consensus_queue.cc:260] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.653874 946 ts_tablet_manager.cc:1428] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260807 20:17:30.653927 947 tablet_bootstrap.cc:492] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854: No bootstrap required, opened a new log
I20260807 20:17:30.653970 947 ts_tablet_manager.cc:1397] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 20:17:30.654006 959 tablet_replica.cc:439] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } } }
I20260807 20:17:30.654062 950 tablet_bootstrap.cc:654] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:30.654073 959 tablet_replica.cc:442] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:30.654139 947 raft_consensus.cc:348] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.654217 947 raft_consensus.cc:374] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:30.654244 947 raft_consensus.cc:729] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb5df52826814b909576acbd80a12854, State: Initialized, Role: FOLLOWER
I20260807 20:17:30.654284 947 consensus_queue.cc:260] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.654361 947 ts_tablet_manager.cc:1428] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:30.654453 972 tablet_replica.cc:439] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } } }
I20260807 20:17:30.654528 972 tablet_replica.cc:442] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:30.655064 950 tablet_bootstrap.cc:492] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864: No bootstrap required, opened a new log
I20260807 20:17:30.655112 950 ts_tablet_manager.cc:1397] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260807 20:17:30.655260 950 raft_consensus.cc:348] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.655313 950 raft_consensus.cc:374] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:30.655331 950 raft_consensus.cc:729] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32cb7c5df4e644a193730bdc33cd4864, State: Initialized, Role: FOLLOWER
I20260807 20:17:30.655371 950 consensus_queue.cc:260] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.655488 950 ts_tablet_manager.cc:1428] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:30.655562 956 tablet_replica.cc:439] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } } }
I20260807 20:17:30.655673 956 tablet_replica.cc:442] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864: This TxnStatusTablet replica's current role is: FOLLOWER
W20260807 20:17:30.656250 468 tablet.cc:2369] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:17:30.716254 912 tablet.cc:2369] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:17:30.812901 674 tablet.cc:2369] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:17:30.844133 959 raft_consensus.cc:482] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:30.844230 959 raft_consensus.cc:504] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.844386 959 leader_election.cc:288] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb5df52826814b909576acbd80a12854 (127.30.35.193:45001), 32cb7c5df4e644a193730bdc33cd4864 (127.30.35.194:41675)
I20260807 20:17:30.844606 395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e99b8b60d4465f8afd80e8e4b0102d" candidate_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb5df52826814b909576acbd80a12854" is_pre_election: true
I20260807 20:17:30.844698 395 raft_consensus.cc:2454] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3e03e0bc9154e379f7d59ad632ce26e in term 0.
I20260807 20:17:30.844871 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e99b8b60d4465f8afd80e8e4b0102d" candidate_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32cb7c5df4e644a193730bdc33cd4864" is_pre_election: true
I20260807 20:17:30.844966 607 raft_consensus.cc:2454] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3e03e0bc9154e379f7d59ad632ce26e in term 0.
I20260807 20:17:30.844957 716 leader_election.cc:302] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3e03e0bc9154e379f7d59ad632ce26e, cb5df52826814b909576acbd80a12854; no voters:
I20260807 20:17:30.845077 959 raft_consensus.cc:2781] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:30.845116 959 raft_consensus.cc:482] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:30.845156 959 raft_consensus.cc:3037] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:30.845886 959 raft_consensus.cc:504] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.846012 959 leader_election.cc:288] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [CANDIDATE]: Term 1 election: Requested vote from peers cb5df52826814b909576acbd80a12854 (127.30.35.193:45001), 32cb7c5df4e644a193730bdc33cd4864 (127.30.35.194:41675)
I20260807 20:17:30.846203 607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e99b8b60d4465f8afd80e8e4b0102d" candidate_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32cb7c5df4e644a193730bdc33cd4864"
I20260807 20:17:30.846206 395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e99b8b60d4465f8afd80e8e4b0102d" candidate_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb5df52826814b909576acbd80a12854"
I20260807 20:17:30.846283 607 raft_consensus.cc:3037] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:30.846293 395 raft_consensus.cc:3037] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:30.847065 607 raft_consensus.cc:2454] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3e03e0bc9154e379f7d59ad632ce26e in term 1.
I20260807 20:17:30.847213 395 raft_consensus.cc:2454] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3e03e0bc9154e379f7d59ad632ce26e in term 1.
I20260807 20:17:30.847272 717 leader_election.cc:302] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32cb7c5df4e644a193730bdc33cd4864, c3e03e0bc9154e379f7d59ad632ce26e; no voters:
I20260807 20:17:30.847345 959 raft_consensus.cc:2781] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:30.847390 959 raft_consensus.cc:686] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [term 1 LEADER]: Becoming Leader. State: Replica: c3e03e0bc9154e379f7d59ad632ce26e, State: Running, Role: LEADER
I20260807 20:17:30.847430 959 consensus_queue.cc:237] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } }
I20260807 20:17:30.847767 989 tablet_replica.cc:439] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e: TxnStatusTablet state changed. Reason: New leader c3e03e0bc9154e379f7d59ad632ce26e. Latest consensus state: current_term: 1 leader_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } } }
I20260807 20:17:30.847855 989 tablet_replica.cc:442] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e: This TxnStatusTablet replica's current role is: LEADER
I20260807 20:17:30.848044 1012 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 20:17:30.848143 1012 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 20:17:30.848093 32606 catalog_manager.cc:5495] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e reported cstate change: term changed from 0 to 1, leader changed from <none> to c3e03e0bc9154e379f7d59ad632ce26e (127.30.35.195). New cstate: current_term: 1 leader_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } health_report { overall_health: HEALTHY } } }
I20260807 20:17:30.883203 944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.880789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36898 (local address 127.30.35.195:38101)
0807 20:17:30.880839 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.880840 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.880848 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:30.880942 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.880943 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.880960 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.881018 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:30.881148 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.881622 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.882432 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.882622 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.882679 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.882861 (+ 182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:30.882973 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:30.883035 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.883093 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.883116 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 20:17:30.883204 1005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.880718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:38101 (local address 127.0.0.1:36898)
0807 20:17:30.880803 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.880814 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.880857 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.881035 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.881036 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.881037 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 20:17:30.881092 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.881095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.881752 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.881754 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.882336 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.882338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.882682 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.882683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.882752 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.882770 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 20:17:30.883030 (+ 260us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 20:17:30.883039 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.883079 (+ 40us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.883132 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 20:17:30.884454 395 raft_consensus.cc:1261] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854 [term 1 FOLLOWER]: Refusing update from remote peer c3e03e0bc9154e379f7d59ad632ce26e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:30.884441 607 raft_consensus.cc:1261] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864 [term 1 FOLLOWER]: Refusing update from remote peer c3e03e0bc9154e379f7d59ad632ce26e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:30.884708 959 consensus_queue.cc:1035] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:30.884863 989 consensus_queue.cc:1035] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:30.885545 972 tablet_replica.cc:439] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854: TxnStatusTablet state changed. Reason: New leader c3e03e0bc9154e379f7d59ad632ce26e. Latest consensus state: current_term: 1 leader_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } } }
I20260807 20:17:30.885640 972 tablet_replica.cc:442] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:30.885826 956 tablet_replica.cc:439] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864: TxnStatusTablet state changed. Reason: New leader c3e03e0bc9154e379f7d59ad632ce26e. Latest consensus state: current_term: 1 leader_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } } }
I20260807 20:17:30.885917 956 tablet_replica.cc:442] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:30.886317 959 tablet_replica.cc:439] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } } }
I20260807 20:17:30.886395 959 tablet_replica.cc:442] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e: This TxnStatusTablet replica's current role is: LEADER
I20260807 20:17:30.886471 968 mvcc.cc:205] Tried to move back new op lower bound from 7316004253220290560 to 7316004253071585280. Current Snapshot: MvccSnapshot[applied={T|T < 7316004253220290560}]
I20260807 20:17:30.886686 972 tablet_replica.cc:439] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } } }
I20260807 20:17:30.886761 972 tablet_replica.cc:442] T e7e99b8b60d4465f8afd80e8e4b0102d P cb5df52826814b909576acbd80a12854: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:30.887840 989 tablet_replica.cc:439] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } } }
I20260807 20:17:30.887943 989 tablet_replica.cc:442] T e7e99b8b60d4465f8afd80e8e4b0102d P c3e03e0bc9154e379f7d59ad632ce26e: This TxnStatusTablet replica's current role is: LEADER
I20260807 20:17:30.888418 975 mvcc.cc:205] Tried to move back new op lower bound from 7316004253220290560 to 7316004253071585280. Current Snapshot: MvccSnapshot[applied={T|T < 7316004253220290560}]
I20260807 20:17:30.888545 956 tablet_replica.cc:439] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 } } peers { permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 } } peers { permanent_uuid: "c3e03e0bc9154e379f7d59ad632ce26e" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38101 } } }
I20260807 20:17:30.888618 956 tablet_replica.cc:442] T e7e99b8b60d4465f8afd80e8e4b0102d P 32cb7c5df4e644a193730bdc33cd4864: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:30.890627 944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.888437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36910 (local address 127.30.35.195:38101)
0807 20:17:30.888469 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.888471 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.888477 (+ 6us) server_negotiation.cc:407] Connection header received
0807 20:17:30.888493 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.888494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.888518 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.888562 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:30.888718 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.889298 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.890060 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.890254 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.890306 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.890433 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:30.890464 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:30.890504 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.890547 (+ 43us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.890565 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 20:17:30.894927 944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.892955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:47053 (local address 127.30.35.195:38101)
0807 20:17:30.892989 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.892991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.892998 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:17:30.893050 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.893051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.893058 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.893096 (+ 38us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:30.893205 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.893625 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.894343 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.894521 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.894572 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.894713 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:30.894742 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:30.894784 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.894824 (+ 40us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.894848 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":19}
I20260807 20:17:30.894929 924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.892897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:38101 (local address 127.30.35.195:47053)
0807 20:17:30.892960 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:30.892971 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:30.893010 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:30.893107 (+ 97us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:30.893108 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:30.893109 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 20:17:30.893157 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.893158 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.893720 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.893721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.894275 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:30.894276 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.894577 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.894578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:30.894636 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.894652 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 20:17:30.894784 (+ 132us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 20:17:30.894785 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 20:17:30.894824 (+ 39us) client_negotiation.cc:240] Negotiation successful
0807 20:17:30.894870 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":6}
I20260807 20:17:30.896934 395 raft_consensus.cc:1261] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854 [term 1 FOLLOWER]: Refusing update from remote peer c3e03e0bc9154e379f7d59ad632ce26e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:30.896950 607 raft_consensus.cc:1261] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864 [term 1 FOLLOWER]: Refusing update from remote peer c3e03e0bc9154e379f7d59ad632ce26e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:30.897153 1021 consensus_queue.cc:1035] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb5df52826814b909576acbd80a12854" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:30.897262 959 consensus_queue.cc:1035] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [LEADER]: Connected to new peer: Peer: permanent_uuid: "32cb7c5df4e644a193730bdc33cd4864" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:30.907888 32604 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:30.907999 32604 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:30.908565 32604 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6ea2e665764b420f987c96f5f6a997b7: Sending DeleteTablet for 3 replicas of tablet 74d1466e541b414ca4b68b6512621a75
I20260807 20:17:30.908787 367 tablet_service.cc:1514] Processing DeleteTablet for tablet 74d1466e541b414ca4b68b6512621a75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:30 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:59116
I20260807 20:17:30.908835 578 tablet_service.cc:1514] Processing DeleteTablet for tablet 74d1466e541b414ca4b68b6512621a75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:30 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:49778
I20260807 20:17:30.908876 983 tablet_replica.cc:330] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854: stopping tablet replica
I20260807 20:17:30.908917 983 raft_consensus.cc:2229] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:30.908908 980 tablet_replica.cc:330] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864: stopping tablet replica
I20260807 20:17:30.908949 983 raft_consensus.cc:2258] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:30.908965 980 raft_consensus.cc:2229] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:30.908995 980 raft_consensus.cc:2258] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:30.909268 788 tablet_service.cc:1514] Processing DeleteTablet for tablet 74d1466e541b414ca4b68b6512621a75 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:30 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:36886
I20260807 20:17:30.909454 980 ts_tablet_manager.cc:1905] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:30.909687 983 ts_tablet_manager.cc:1905] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:30.911145 980 ts_tablet_manager.cc:1918] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 20:17:30.911196 980 log.cc:1196] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/74d1466e541b414ca4b68b6512621a75
I20260807 20:17:30.911315 983 ts_tablet_manager.cc:1918] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 20:17:30.911381 980 ts_tablet_manager.cc:1939] T 74d1466e541b414ca4b68b6512621a75 P 32cb7c5df4e644a193730bdc33cd4864: Deleting consensus metadata
I20260807 20:17:30.911384 983 log.cc:1196] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-0/wal/wals/74d1466e541b414ca4b68b6512621a75
I20260807 20:17:30.911523 982 tablet_replica.cc:330] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e: stopping tablet replica
I20260807 20:17:30.911581 982 raft_consensus.cc:2229] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:17:30.911597 983 ts_tablet_manager.cc:1939] T 74d1466e541b414ca4b68b6512621a75 P cb5df52826814b909576acbd80a12854: Deleting consensus metadata
I20260807 20:17:30.911674 982 raft_consensus.cc:2258] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:30.911969 32582 catalog_manager.cc:4841] TS cb5df52826814b909576acbd80a12854 (127.30.35.193:45001): tablet 74d1466e541b414ca4b68b6512621a75 (table test-table [id=68fa5e64b6a14a3e9b458aa8dcfa1934]) successfully deleted
I20260807 20:17:30.912101 982 ts_tablet_manager.cc:1905] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:30.913367 982 ts_tablet_manager.cc:1918] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 20:17:30.913414 982 log.cc:1196] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/74d1466e541b414ca4b68b6512621a75
I20260807 20:17:30.913595 982 ts_tablet_manager.cc:1939] T 74d1466e541b414ca4b68b6512621a75 P c3e03e0bc9154e379f7d59ad632ce26e: Deleting consensus metadata
I20260807 20:17:30.914054 32583 catalog_manager.cc:4841] TS c3e03e0bc9154e379f7d59ad632ce26e (127.30.35.195:38101): tablet 74d1466e541b414ca4b68b6512621a75 (table test-table [id=68fa5e64b6a14a3e9b458aa8dcfa1934]) successfully deleted
I20260807 20:17:30.914242 32583 catalog_manager.cc:4841] TS 32cb7c5df4e644a193730bdc33cd4864 (127.30.35.194:41675): tablet 74d1466e541b414ca4b68b6512621a75 (table test-table [id=68fa5e64b6a14a3e9b458aa8dcfa1934]) successfully deleted
Aug 07 20:17:30 dist-test-slave-t7g5 krb5kdc[32537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133850, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.35.193@KRBTEST.COM
I20260807 20:17:30.918681 942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.909564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59138 (local address 127.30.35.193:45001)
0807 20:17:30.909601 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.909603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.909879 (+ 276us) server_negotiation.cc:407] Connection header received
0807 20:17:30.909965 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.909966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.909976 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.910002 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:30.910751 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.911444 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.912403 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.912686 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.912764 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.915796 (+ 3032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:30.915805 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:30.915805 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:30.915813 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:30.917540 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.917893 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.917897 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.917897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.917968 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.918121 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.918122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.918122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.918295 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:30.918452 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.918508 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.918594 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260807 20:17:30.918962 455 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59138
I20260807 20:17:30.926386 32692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:30.920151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36026 (local address 127.30.35.254:33331)
0807 20:17:30.920194 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:30.920196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:30.920275 (+ 79us) server_negotiation.cc:407] Connection header received
0807 20:17:30.920345 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:30.920346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:30.920354 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:30.920395 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:30.920961 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.921428 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.922425 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:30.922602 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:30.922646 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:30.923960 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:30.923961 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:30.923961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:30.923968 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:30.925263 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.925672 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.925673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.925673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.925729 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:30.925936 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:30.925936 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:30.925936 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:30.926034 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:30.926100 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:30.926263 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 20:17:30.926323 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
W20260807 20:17:30.926744 32604 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36026
I20260807 20:17:30.927371 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 32726
I20260807 20:17:30.944662 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 478
I20260807 20:17:30.954698 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 689
I20260807 20:17:30.963816 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 32556
2026-08-07T20:17:30Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2382 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:17:31 dist-test-slave-t7g5 krb5kdc[1036](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:17:31 dist-test-slave-t7g5 krb5kdc[1036](info): set up 2 sockets
Aug 07 20:17:31 dist-test-slave-t7g5 krb5kdc[1036](info): commencing operation
krb5kdc: starting...
W20260807 20:17:32.105370 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:17:32 dist-test-slave-t7g5 krb5kdc[1036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:17:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:17:32.227624 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:40467
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:40151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:40467
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:32.308169 1057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:32.308380 1057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:32.308409 1057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:32.309533 1057 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:32.309576 1057 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 20:17:32.309592 1057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:32.309608 1057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:32.309624 1057 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:32.309640 1057 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:32.311154 1057 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:40467
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:40467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1057
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:32.311395 1057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:32.311599 1057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:32.316200 1067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:32.316371 1057 server_base.cc:1034] running on GCE node
W20260807 20:17:32.316190 1066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:32.316215 1071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:32.316732 1057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:32.317026 1057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:32.318181 1057 hybrid_clock.cc:648] HybridClock initialized: now 1786133852318166 us; error 29 us; skew 500 ppm
Aug 07 20:17:32 dist-test-slave-t7g5 krb5kdc[1036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133852, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:32.320657 1057 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:17:32.321116 1057 webserver.cc:460] Webserver started at http://127.30.35.254:34279/ using document root <none> and password file <none>
I20260807 20:17:32.321341 1057 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:32.321394 1057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:32.321525 1057 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:32.322712 1057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "3fe618a9022a4e4cbe67ce735f346678"
format_stamp: "Formatted at 2026-08-07 20:17:32 on dist-test-slave-t7g5"
server_key: "659f3dd1893d6095f96ff4df69d0a133"
server_key_iv: "40ac4578cecab94702b8d441a5d509cb"
server_key_version: "encryptionkey@0"
I20260807 20:17:32.323063 1057 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "3fe618a9022a4e4cbe67ce735f346678"
format_stamp: "Formatted at 2026-08-07 20:17:32 on dist-test-slave-t7g5"
server_key: "659f3dd1893d6095f96ff4df69d0a133"
server_key_iv: "40ac4578cecab94702b8d441a5d509cb"
server_key_version: "encryptionkey@0"
I20260807 20:17:32.324333 1057 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:32.325109 1080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:32.325268 1057 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:32.325349 1057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "3fe618a9022a4e4cbe67ce735f346678"
format_stamp: "Formatted at 2026-08-07 20:17:32 on dist-test-slave-t7g5"
server_key: "659f3dd1893d6095f96ff4df69d0a133"
server_key_iv: "40ac4578cecab94702b8d441a5d509cb"
server_key_version: "encryptionkey@0"
I20260807 20:17:32.325415 1057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:32.335433 1057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:32.337383 1057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:32.337519 1057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:32.341953 1057 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:40467
I20260807 20:17:32.341990 1164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:40467 every 8 connection(s)
I20260807 20:17:32.342309 1057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:32.342711 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 1057
I20260807 20:17:32.342789 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:32.342954 30863 external_mini_cluster.cc:1428] Setting key 4fb517fba3174abfd345def543fa8b19
I20260807 20:17:32.343017 1166 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:32.346333 1166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678: Bootstrap starting.
I20260807 20:17:32.346907 1166 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:32.347225 1166 log.cc:824] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:32.347926 1166 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678: No bootstrap required, opened a new log
Aug 07 20:17:32 dist-test-slave-t7g5 krb5kdc[1036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:32.350186 1166 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fe618a9022a4e4cbe67ce735f346678" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40467 } }
I20260807 20:17:32.350359 1166 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:32.350396 1166 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fe618a9022a4e4cbe67ce735f346678, State: Initialized, Role: FOLLOWER
I20260807 20:17:32.350528 1166 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fe618a9022a4e4cbe67ce735f346678" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40467 } }
I20260807 20:17:32.350595 1166 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:32.350626 1166 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:32.350677 1166 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:32.351176 1166 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fe618a9022a4e4cbe67ce735f346678" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40467 } }
I20260807 20:17:32.351264 1166 leader_election.cc:302] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3fe618a9022a4e4cbe67ce735f346678; no voters:
I20260807 20:17:32.351416 1166 leader_election.cc:288] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:32.351467 1175 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:32.351579 1175 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [term 1 LEADER]: Becoming Leader. State: Replica: 3fe618a9022a4e4cbe67ce735f346678, State: Running, Role: LEADER
I20260807 20:17:32.351660 1175 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fe618a9022a4e4cbe67ce735f346678" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40467 } }
I20260807 20:17:32.351712 1166 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:32.351981 1175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3fe618a9022a4e4cbe67ce735f346678. Latest consensus state: current_term: 1 leader_uuid: "3fe618a9022a4e4cbe67ce735f346678" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fe618a9022a4e4cbe67ce735f346678" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40467 } } }
I20260807 20:17:32.352052 1175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:32.351998 1177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3fe618a9022a4e4cbe67ce735f346678" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fe618a9022a4e4cbe67ce735f346678" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40467 } } }
I20260807 20:17:32.352242 1177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:32.352242 1180 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:32.352917 1180 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:32.353995 1173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.343451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48600 (local address 127.30.35.254:40467)
0807 20:17:32.343638 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:32.343648 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:32.343683 (+ 35us) server_negotiation.cc:407] Connection header received
0807 20:17:32.344112 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:32.344121 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:32.344186 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:32.344331 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:32.344880 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.346253 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.346999 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.347558 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.347647 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.350086 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:32.350091 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:32.350091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:32.350103 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:32.351923 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.352334 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.352337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.352337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.352444 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.352663 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.352663 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.352664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.352972 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:32.353564 (+ 592us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:32.353639 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 20:17:32.353785 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":86,"threads_started":1}
I20260807 20:17:32.354529 1180 catalog_manager.cc:1347] Generated new cluster ID: cbe3191d39474462b03df3634c5d2a82
I20260807 20:17:32.354578 1180 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:17:32.363554 1180 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:32.364060 1180 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:32.369071 1180 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678: Generated new TSK 0
I20260807 20:17:32.369230 1180 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:17:32.393863 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40467
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:40151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:32.473825 1205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:32.474054 1205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:32.474078 1205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:32.475216 1205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:32.475260 1205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:32.475281 1205 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 20:17:32.475304 1205 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 20:17:32.475332 1205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:17:32.476814 1205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.35.254:40467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:32.477056 1205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:32.477272 1205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:32.482040 1218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:32.482015 1220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:32.482020 1217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:32.482098 1205 server_base.cc:1034] running on GCE node
I20260807 20:17:32.482395 1205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:32.482621 1205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:32.483755 1205 hybrid_clock.cc:648] HybridClock initialized: now 1786133852483739 us; error 34 us; skew 500 ppm
Aug 07 20:17:32 dist-test-slave-t7g5 krb5kdc[1036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133852, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:32.486102 1205 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:17:32.486496 1205 webserver.cc:460] Webserver started at http://127.30.35.193:44567/ using document root <none> and password file <none>
I20260807 20:17:32.486691 1205 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:32.486738 1205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:32.486862 1205 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:32.487906 1205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "ad974baaca0e4e15846675a219f45b91"
format_stamp: "Formatted at 2026-08-07 20:17:32 on dist-test-slave-t7g5"
server_key: "c858341a866c3b223f5ca42cf7aeca59"
server_key_iv: "5203fc7a5d62284f2948dee7a63117a9"
server_key_version: "encryptionkey@0"
I20260807 20:17:32.488245 1205 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "ad974baaca0e4e15846675a219f45b91"
format_stamp: "Formatted at 2026-08-07 20:17:32 on dist-test-slave-t7g5"
server_key: "c858341a866c3b223f5ca42cf7aeca59"
server_key_iv: "5203fc7a5d62284f2948dee7a63117a9"
server_key_version: "encryptionkey@0"
I20260807 20:17:32.489481 1205 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:32.490212 1230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:32.490355 1205 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:32.490439 1205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "ad974baaca0e4e15846675a219f45b91"
format_stamp: "Formatted at 2026-08-07 20:17:32 on dist-test-slave-t7g5"
server_key: "c858341a866c3b223f5ca42cf7aeca59"
server_key_iv: "5203fc7a5d62284f2948dee7a63117a9"
server_key_version: "encryptionkey@0"
I20260807 20:17:32.490502 1205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:32.503412 1205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:32.505383 1205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:32.505527 1205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:32.506073 1205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:32.506114 1205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:32.506143 1205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:32.506170 1205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:32.512552 1205 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:33383
I20260807 20:17:32.512712 1407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:33383 every 8 connection(s)
Aug 07 20:17:32 dist-test-slave-t7g5 krb5kdc[1036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133852, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:32.512971 1205 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:17:32.515749 1173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.506527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:58929 (local address 127.30.35.254:40467)
0807 20:17:32.506567 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:32.506570 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:32.506790 (+ 220us) server_negotiation.cc:407] Connection header received
0807 20:17:32.507298 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:32.507300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:32.507313 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:32.507384 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:32.508163 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.508912 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.510433 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.510751 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.510826 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.513465 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:32.513466 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:32.513467 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:32.513474 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:32.514660 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.515042 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.515043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.515043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.515086 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.515249 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.515249 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.515250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.515347 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:32.515392 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:32.515619 (+ 227us) server_negotiation.cc:299] Negotiation successful
0807 20:17:32.515684 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 20:17:32.515992 1248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.506531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40467 (local address 127.30.35.193:58929)
0807 20:17:32.506678 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:32.506713 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:32.507203 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:32.507442 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:32.507446 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:32.507753 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:32.508055 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.508063 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.509010 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.509011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.510334 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.510337 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.510831 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.510831 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.510938 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.511480 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:32.511491 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:32.513383 (+ 1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:32.514752 (+ 1369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:32.514759 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:32.514761 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:32.514983 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:32.515124 (+ 141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:32.515124 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:32.515124 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:32.515209 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:32.515389 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:32.515393 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:32.515525 (+ 132us) client_negotiation.cc:769] Sending connection context
0807 20:17:32.515604 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 20:17:32.515755 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":87,"threads_started":1}
I20260807 20:17:32.516494 1408 heartbeater.cc:347] Connected to a master server at 127.30.35.254:40467
I20260807 20:17:32.516580 1408 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:32.516760 1408 heartbeater.cc:511] Master 127.30.35.254:40467 requested a full tablet report, sending...
I20260807 20:17:32.517270 1104 ts_manager.cc:194] Registered new tserver with Master: ad974baaca0e4e15846675a219f45b91 (127.30.35.193:33383)
I20260807 20:17:32.518018 1104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:58929
I20260807 20:17:32.518743 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 1205
I20260807 20:17:32.518836 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:17:32.518997 30863 external_mini_cluster.cc:1428] Setting key e2721e30ac46110815768e06dd84e073
I20260807 20:17:32.523672 1422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.517511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40467 (local address 127.30.35.193:52127)
0807 20:17:32.518230 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:32.518242 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:32.518298 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:32.518425 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:32.518425 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:32.518622 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:32.518690 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.518692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.519534 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.519535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.520106 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.520108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.520441 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.520442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.520517 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.520938 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:32.520943 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:32.521254 (+ 311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:32.522746 (+ 1492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:32.522747 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:32.522747 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:32.522916 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:32.523105 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:32.523105 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:32.523105 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:32.523153 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:32.523395 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:32.523396 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:32.523443 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 20:17:32.523514 (+ 71us) client_negotiation.cc:240] Negotiation successful
0807 20:17:32.523600 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"thread_start_us":74,"threads_started":1}
I20260807 20:17:32.523715 1173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.517562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:52127 (local address 127.30.35.254:40467)
0807 20:17:32.517599 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:32.517601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:32.518300 (+ 699us) server_negotiation.cc:407] Connection header received
0807 20:17:32.518331 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:32.518331 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:32.518343 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:32.518410 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:32.518784 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.519408 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.520179 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.520377 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.520432 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.521332 (+ 900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:32.521334 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:32.521334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:32.521341 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:32.522640 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.522983 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.522984 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.522985 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.523049 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.523198 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.523198 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.523199 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.523316 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:32.523379 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:32.523549 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 20:17:32.523630 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:17:32.544031 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40467
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:40151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:32.625226 1425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:32.625439 1425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:32.625463 1425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:32.626579 1425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:32.626619 1425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:32.626638 1425 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 20:17:32.626655 1425 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 20:17:32.626672 1425 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:17:32.628326 1425 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.35.254:40467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:32.628516 1425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:32.628736 1425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:32.633477 1436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:32.633486 1433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:32.633546 1425 server_base.cc:1034] running on GCE node
W20260807 20:17:32.633486 1432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:32.633878 1425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:32.634073 1425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:32.635219 1425 hybrid_clock.cc:648] HybridClock initialized: now 1786133852635204 us; error 29 us; skew 500 ppm
Aug 07 20:17:32 dist-test-slave-t7g5 krb5kdc[1036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133852, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:32.637614 1425 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:17:32.638096 1425 webserver.cc:460] Webserver started at http://127.30.35.194:44407/ using document root <none> and password file <none>
I20260807 20:17:32.638293 1425 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:32.638341 1425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:32.638464 1425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:32.639504 1425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "134c56f4bf3c45c588afd7de05ea4318"
format_stamp: "Formatted at 2026-08-07 20:17:32 on dist-test-slave-t7g5"
server_key: "e59187f07225629c11ff492cbd3abd29"
server_key_iv: "26e3f3800528cec4424d43387e74018c"
server_key_version: "encryptionkey@0"
I20260807 20:17:32.639839 1425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "134c56f4bf3c45c588afd7de05ea4318"
format_stamp: "Formatted at 2026-08-07 20:17:32 on dist-test-slave-t7g5"
server_key: "e59187f07225629c11ff492cbd3abd29"
server_key_iv: "26e3f3800528cec4424d43387e74018c"
server_key_version: "encryptionkey@0"
I20260807 20:17:32.641080 1425 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 20:17:32.641795 1455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:32.641944 1425 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:32.642030 1425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "134c56f4bf3c45c588afd7de05ea4318"
format_stamp: "Formatted at 2026-08-07 20:17:32 on dist-test-slave-t7g5"
server_key: "e59187f07225629c11ff492cbd3abd29"
server_key_iv: "26e3f3800528cec4424d43387e74018c"
server_key_version: "encryptionkey@0"
I20260807 20:17:32.642098 1425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:32.670796 1425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:32.672506 1425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:32.672647 1425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:32.673192 1425 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:32.673235 1425 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:32.673265 1425 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:32.673307 1425 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 20:17:32 dist-test-slave-t7g5 krb5kdc[1036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133852, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:32.680338 1425 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:39453
I20260807 20:17:32.680444 1627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:39453 every 8 connection(s)
I20260807 20:17:32.680733 1425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:17:32.682600 1173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.673850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:42351 (local address 127.30.35.254:40467)
0807 20:17:32.673910 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:32.673912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:32.673923 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:17:32.674517 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:32.674518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:32.674527 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:32.674570 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:32.675433 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.676004 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.677486 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.677739 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.677792 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.680082 (+ 2290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:32.680084 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:32.680085 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:32.680093 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:32.681515 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.681920 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.681920 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.681921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.681970 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.682148 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.682148 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.682148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.682242 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:32.682286 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:32.682477 (+ 191us) server_negotiation.cc:299] Negotiation successful
0807 20:17:32.682539 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 20:17:32.682757 1465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.673553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40467 (local address 127.30.35.194:42351)
0807 20:17:32.673722 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:32.673772 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:32.674416 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:32.674653 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:32.674658 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:32.675014 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:32.675314 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.675322 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.676079 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.676080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.677388 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.677391 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.677816 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.677817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.677964 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.678483 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:32.678494 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:32.679989 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:32.681581 (+ 1592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:32.681586 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:32.681588 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:32.681858 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:32.682017 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:32.682017 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:32.682017 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:32.682109 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:32.682283 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:32.682286 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:32.682391 (+ 105us) client_negotiation.cc:769] Sending connection context
0807 20:17:32.682466 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 20:17:32.682577 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
I20260807 20:17:32.683189 1628 heartbeater.cc:347] Connected to a master server at 127.30.35.254:40467
I20260807 20:17:32.683274 1628 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:32.683460 1628 heartbeater.cc:511] Master 127.30.35.254:40467 requested a full tablet report, sending...
I20260807 20:17:32.683835 1106 ts_manager.cc:194] Registered new tserver with Master: 134c56f4bf3c45c588afd7de05ea4318 (127.30.35.194:39453)
I20260807 20:17:32.684288 1106 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:42351
I20260807 20:17:32.688788 1635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.684181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40467 (local address 127.30.35.194:36665)
0807 20:17:32.684309 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:32.684318 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:32.684379 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:32.684499 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:32.684499 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:32.684666 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:32.684728 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.684730 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.685310 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.685310 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.685844 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.685846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.686129 (+ 283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.686129 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.686179 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.686483 (+ 304us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:32.686487 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:32.686744 (+ 257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:32.688054 (+ 1310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:32.688055 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:32.688055 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:32.688203 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:32.688343 (+ 140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:32.688343 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:32.688343 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:32.688385 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:32.688574 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:32.688574 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:32.688607 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 20:17:32.688650 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 20:17:32.688720 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":75,"threads_started":1}
I20260807 20:17:32.688802 1173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.684236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:36665 (local address 127.30.35.254:40467)
0807 20:17:32.684269 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:32.684271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:32.684383 (+ 112us) server_negotiation.cc:407] Connection header received
0807 20:17:32.684441 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:32.684442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:32.684451 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:32.684498 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:32.684796 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.685230 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.685907 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.686078 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.686126 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.686818 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:32.686819 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:32.686819 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:32.686825 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:32.687986 (+ 1161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.688258 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.688259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.688259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.688307 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.688416 (+ 109us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.688416 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.688417 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.688533 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:32.688577 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:32.688667 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 20:17:32.688747 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260807 20:17:32.689458 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 1425
I20260807 20:17:32.689561 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:17:32.689803 30863 external_mini_cluster.cc:1428] Setting key cfbbadda580f48b63bd5630697109703
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:17:32.712783 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40467
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:40151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:32.793506 1638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:32.793743 1638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:32.793768 1638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:32.794968 1638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:32.795015 1638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:32.795035 1638 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 20:17:32.795045 1638 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 20:17:32.795060 1638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:17:32.796507 1638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.35.254:40467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:32.796730 1638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:32.796954 1638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:32.801774 1644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:32.801827 1646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:32.801777 1648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:32.801954 1638 server_base.cc:1034] running on GCE node
I20260807 20:17:32.802210 1638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:32.802408 1638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:32.803543 1638 hybrid_clock.cc:648] HybridClock initialized: now 1786133852803529 us; error 30 us; skew 500 ppm
Aug 07 20:17:32 dist-test-slave-t7g5 krb5kdc[1036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133852, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:32.805971 1638 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:17:32.806380 1638 webserver.cc:460] Webserver started at http://127.30.35.195:42397/ using document root <none> and password file <none>
I20260807 20:17:32.806578 1638 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:32.806627 1638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:32.806751 1638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:32.807807 1638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2"
format_stamp: "Formatted at 2026-08-07 20:17:32 on dist-test-slave-t7g5"
server_key: "f5204ba7fb641630d2b2106bc9a78f85"
server_key_iv: "2af462138a5805eced67ba086ff36232"
server_key_version: "encryptionkey@0"
I20260807 20:17:32.808174 1638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2"
format_stamp: "Formatted at 2026-08-07 20:17:32 on dist-test-slave-t7g5"
server_key: "f5204ba7fb641630d2b2106bc9a78f85"
server_key_iv: "2af462138a5805eced67ba086ff36232"
server_key_version: "encryptionkey@0"
I20260807 20:17:32.809432 1638 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:32.810174 1657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:32.810333 1638 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:32.810417 1638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2"
format_stamp: "Formatted at 2026-08-07 20:17:32 on dist-test-slave-t7g5"
server_key: "f5204ba7fb641630d2b2106bc9a78f85"
server_key_iv: "2af462138a5805eced67ba086ff36232"
server_key_version: "encryptionkey@0"
I20260807 20:17:32.810485 1638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:32.832562 1638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:32.834899 1638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:32.835057 1638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:32.835604 1638 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:32.835647 1638 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:32.835680 1638 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:32.835698 1638 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 20:17:32 dist-test-slave-t7g5 krb5kdc[1036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133852, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:32.842239 1638 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:36241
I20260807 20:17:32.842325 1833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:36241 every 8 connection(s)
I20260807 20:17:32.842607 1638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:17:32.844827 1173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.836077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:47341 (local address 127.30.35.254:40467)
0807 20:17:32.836144 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:32.836146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:32.836356 (+ 210us) server_negotiation.cc:407] Connection header received
0807 20:17:32.836861 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:32.836863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:32.836877 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:32.836946 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:32.837847 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.838599 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.839592 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.839882 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.839957 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.842299 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:32.842301 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:32.842301 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:32.842310 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:32.843615 (+ 1305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.844001 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.844002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.844002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.844059 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.844224 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.844225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.844225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.844324 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:32.844370 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:32.844663 (+ 293us) server_negotiation.cc:299] Negotiation successful
0807 20:17:32.844726 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 20:17:32.844934 1668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.836051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40467 (local address 127.30.35.195:47341)
0807 20:17:32.836212 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:32.836253 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:32.836755 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:32.837025 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:32.837028 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:32.837384 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:32.837730 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.837737 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.838692 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.838693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.839518 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.839520 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.839970 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.839971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.840117 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.840612 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:32.840622 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:32.842193 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:32.843682 (+ 1489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:32.843685 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:32.843687 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:32.843945 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:32.844096 (+ 151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:32.844096 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:32.844096 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:32.844185 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:32.844367 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:32.844370 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:32.844506 (+ 136us) client_negotiation.cc:769] Sending connection context
0807 20:17:32.844640 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 20:17:32.844764 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":90,"threads_started":1}
I20260807 20:17:32.845396 1834 heartbeater.cc:347] Connected to a master server at 127.30.35.254:40467
I20260807 20:17:32.845479 1834 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:32.845638 1834 heartbeater.cc:511] Master 127.30.35.254:40467 requested a full tablet report, sending...
I20260807 20:17:32.846032 1104 ts_manager.cc:194] Registered new tserver with Master: 48cf55f0bfc54c0ab9e6d61d4e2054d2 (127.30.35.195:36241)
I20260807 20:17:32.846405 1104 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:47341
I20260807 20:17:32.847721 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 1638
I20260807 20:17:32.847810 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:17:32.847977 30863 external_mini_cluster.cc:1428] Setting key df0a618dd14e3c1af8983a41e38da5af
I20260807 20:17:32.848699 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:17:32.851820 1173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.846499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:53555 (local address 127.30.35.254:40467)
0807 20:17:32.846535 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:32.846537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:32.846627 (+ 90us) server_negotiation.cc:407] Connection header received
0807 20:17:32.846690 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:32.846690 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:32.846698 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:32.846749 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:32.847080 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.847542 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.848434 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.848659 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.848717 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.849521 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:32.849522 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:32.849522 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:32.849529 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:32.850803 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.851188 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.851189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.851189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.851239 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.851429 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.851430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.851430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.851517 (+ 87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:32.851561 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:32.851696 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 20:17:32.851749 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 20:17:32.851869 1848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.846442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40467 (local address 127.30.35.195:53555)
0807 20:17:32.846577 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:32.846587 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:32.846639 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:32.846801 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:32.846803 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:32.846950 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:32.847013 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.847015 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.847627 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.847628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.848356 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.848359 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.848726 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.848727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.848808 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.849170 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:32.849175 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:32.849442 (+ 267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:32.850887 (+ 1445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:32.850888 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:32.850889 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:32.851128 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:32.851299 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:32.851299 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:32.851300 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:32.851362 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:32.851563 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:32.851564 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:32.851610 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 20:17:32.851678 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 20:17:32.851773 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":72,"threads_started":1}
Aug 07 20:17:32 dist-test-slave-t7g5 krb5kdc[1036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 20:17:32 dist-test-slave-t7g5 krb5kdc[1036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133852, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:32.871651 1173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.865497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48616 (local address 127.30.35.254:40467)
0807 20:17:32.865547 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:32.865549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:32.865558 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:32.865582 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:32.865583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:32.865592 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:32.865639 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:32.866238 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.866723 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.867405 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.867583 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.867628 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.869750 (+ 2122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:32.869752 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:32.869752 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:32.869759 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:32.870826 (+ 1067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.871102 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.871103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.871103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.871152 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:32.871281 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:32.871282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:32.871282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:32.871374 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:32.871440 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:32.871526 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 20:17:32.871584 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 20:17:32.873098 1104 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:17:32.874691 1104 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:32.880779 1867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.876889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:39453 (local address 127.0.0.1:51850)
0807 20:17:32.877262 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:32.877270 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:32.877306 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:32.877677 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:32.877678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:32.877681 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:32.877734 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.877735 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.878652 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.878653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.879622 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.879625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.880464 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.880465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.880546 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.880562 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 20:17:32.880637 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 20:17:32.880692 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":3,"thread_start_us":85,"threads_started":1}
I20260807 20:17:32.880791 1873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.877312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51850 (local address 127.30.35.194:39453)
0807 20:17:32.877504 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:32.877508 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:32.877516 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:32.877551 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:32.877553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:32.877566 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:32.877809 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:32.877873 (+ 64us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.878574 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.879761 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.880378 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.880462 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.880525 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:32.880655 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 20:17:32.880694 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":95,"threads_started":1}
I20260807 20:17:32.881282 1866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.876888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:36241 (local address 127.0.0.1:36832)
0807 20:17:32.877154 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:32.877163 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:32.877207 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:32.877535 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:32.877539 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:32.877542 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:32.877610 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.877612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.878963 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.878964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.880126 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.880128 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.881063 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.881064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.881127 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.881130 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:32.881175 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:17:32.881215 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":3,"thread_start_us":88,"threads_started":1}
I20260807 20:17:32.881323 1872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.877121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36832 (local address 127.30.35.195:36241)
0807 20:17:32.877279 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:32.877285 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:32.877296 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:17:32.877338 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:32.877340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:32.877356 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:32.877443 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:32.877715 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.878864 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.880213 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.880899 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.880975 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.881029 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:32.881202 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 20:17:32.881237 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":69,"threads_started":1}
I20260807 20:17:32.881475 1870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.876884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:33383 (local address 127.0.0.1:34388)
0807 20:17:32.877051 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:32.877095 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:32.877166 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:32.877700 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:32.877701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:32.877703 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:32.877739 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.877741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.879012 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.879013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.880125 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:32.880128 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.881263 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.881264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:32.881334 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.881338 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:32.881366 (+ 28us) client_negotiation.cc:240] Negotiation successful
0807 20:17:32.881404 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":8,"thread_start_us":52,"threads_started":1}
I20260807 20:17:32.881610 1529 tablet_service.cc:1467] Processing CreateTablet for tablet 16953170177b48a7aab7a2590de348fc (DEFAULT_TABLE table=test-table [id=5b29aaa6f79f42a7996ff81afe309551]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:32.882078 1529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16953170177b48a7aab7a2590de348fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:32.882115 1871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:32.877008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34388 (local address 127.30.35.193:33383)
0807 20:17:32.877397 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:32.877401 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:32.877409 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:32.877459 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:32.877461 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:32.877475 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:32.877555 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:32.877839 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.878928 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.880224 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:32.881170 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:32.881894 (+ 724us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:32.881958 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:32.881984 (+ 26us) server_negotiation.cc:299] Negotiation successful
0807 20:17:32.882022 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":73,"threads_started":1}
I20260807 20:17:32.882144 1729 tablet_service.cc:1467] Processing CreateTablet for tablet 16953170177b48a7aab7a2590de348fc (DEFAULT_TABLE table=test-table [id=5b29aaa6f79f42a7996ff81afe309551]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:32.882465 1729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16953170177b48a7aab7a2590de348fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:32.882664 1311 tablet_service.cc:1467] Processing CreateTablet for tablet 16953170177b48a7aab7a2590de348fc (DEFAULT_TABLE table=test-table [id=5b29aaa6f79f42a7996ff81afe309551]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:32.883008 1311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16953170177b48a7aab7a2590de348fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:32.885071 1874 tablet_bootstrap.cc:492] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Bootstrap starting.
I20260807 20:17:32.886054 1874 tablet_bootstrap.cc:654] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:32.886133 1875 tablet_bootstrap.cc:492] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318: Bootstrap starting.
I20260807 20:17:32.886583 1877 tablet_bootstrap.cc:492] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91: Bootstrap starting.
I20260807 20:17:32.886595 1874 log.cc:824] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:32.886732 1875 tablet_bootstrap.cc:654] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:32.887071 1875 log.cc:824] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:32.887205 1877 tablet_bootstrap.cc:654] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:32.887460 1874 tablet_bootstrap.cc:492] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2: No bootstrap required, opened a new log
I20260807 20:17:32.887526 1874 ts_tablet_manager.cc:1397] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 20:17:32.887545 1877 log.cc:824] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:32.887884 1875 tablet_bootstrap.cc:492] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318: No bootstrap required, opened a new log
I20260807 20:17:32.887966 1875 ts_tablet_manager.cc:1397] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:32.888291 1877 tablet_bootstrap.cc:492] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91: No bootstrap required, opened a new log
I20260807 20:17:32.888422 1877 ts_tablet_manager.cc:1397] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:17:32.889456 1874 raft_consensus.cc:348] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } }
I20260807 20:17:32.889632 1874 raft_consensus.cc:374] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:32.889696 1874 raft_consensus.cc:729] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48cf55f0bfc54c0ab9e6d61d4e2054d2, State: Initialized, Role: FOLLOWER
I20260807 20:17:32.889842 1874 consensus_queue.cc:260] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } }
I20260807 20:17:32.889866 1875 raft_consensus.cc:348] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } }
I20260807 20:17:32.890030 1875 raft_consensus.cc:374] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:32.889925 1877 raft_consensus.cc:348] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } }
I20260807 20:17:32.890069 1875 raft_consensus.cc:729] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 134c56f4bf3c45c588afd7de05ea4318, State: Initialized, Role: FOLLOWER
I20260807 20:17:32.890077 1877 raft_consensus.cc:374] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:32.890108 1877 raft_consensus.cc:729] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad974baaca0e4e15846675a219f45b91, State: Initialized, Role: FOLLOWER
I20260807 20:17:32.890120 1874 ts_tablet_manager.cc:1428] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:17:32.890192 1875 consensus_queue.cc:260] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } }
I20260807 20:17:32.890220 1877 consensus_queue.cc:260] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } }
I20260807 20:17:32.890262 1834 heartbeater.cc:503] Master 127.30.35.254:40467 was elected leader, sending a full tablet report...
I20260807 20:17:32.890465 1875 ts_tablet_manager.cc:1428] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 20:17:32.890483 1877 ts_tablet_manager.cc:1428] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 20:17:32.890484 1628 heartbeater.cc:503] Master 127.30.35.254:40467 was elected leader, sending a full tablet report...
I20260807 20:17:32.890640 1408 heartbeater.cc:503] Master 127.30.35.254:40467 was elected leader, sending a full tablet report...
W20260807 20:17:32.931440 1629 tablet.cc:2369] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:17:33.007690 1887 raft_consensus.cc:482] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:33.007822 1887 raft_consensus.cc:504] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } }
I20260807 20:17:33.008201 1887 leader_election.cc:288] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48cf55f0bfc54c0ab9e6d61d4e2054d2 (127.30.35.195:36241), ad974baaca0e4e15846675a219f45b91 (127.30.35.193:33383)
I20260807 20:17:33.010957 1872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.008475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:60437 (local address 127.30.35.195:36241)
0807 20:17:33.008518 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:33.008519 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:33.008529 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:17:33.008581 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:33.008582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:33.008592 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:33.008643 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:33.008778 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.009265 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.010256 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.010637 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.010701 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.010711 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:33.010836 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 20:17:33.010874 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 20:17:33.010978 1465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.008385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:36241 (local address 127.30.35.194:60437)
0807 20:17:33.008457 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:33.008468 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:33.008516 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:33.008651 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:33.008652 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:33.008653 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:33.008721 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.008722 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.009338 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.009340 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.010170 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.010172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.010705 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.010706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.010776 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.010779 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:33.010824 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:17:33.010864 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":21}
I20260807 20:17:33.010998 1871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.008474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:53841 (local address 127.30.35.193:33383)
0807 20:17:33.008520 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:33.008522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:33.008662 (+ 140us) server_negotiation.cc:407] Connection header received
0807 20:17:33.008723 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:33.008724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:33.008733 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:33.008780 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:33.008918 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.009379 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.010304 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.010686 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.010748 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.010757 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:33.010891 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 20:17:33.010929 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 20:17:33.011230 1891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.008400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:33383 (local address 127.30.35.194:53841)
0807 20:17:33.008585 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:33.008594 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:33.008666 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:33.008782 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:33.008783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:33.008784 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:33.008851 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.008853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.009449 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.009450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.010219 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.010222 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.010758 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.010759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.010824 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.010827 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:33.010874 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 20:17:33.010914 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":122,"threads_started":1}
I20260807 20:17:33.011369 1758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16953170177b48a7aab7a2590de348fc" candidate_uuid: "134c56f4bf3c45c588afd7de05ea4318" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" is_pre_election: true
I20260807 20:17:33.011531 1758 raft_consensus.cc:2454] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 134c56f4bf3c45c588afd7de05ea4318 in term 0.
I20260807 20:17:33.011610 1341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16953170177b48a7aab7a2590de348fc" candidate_uuid: "134c56f4bf3c45c588afd7de05ea4318" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad974baaca0e4e15846675a219f45b91" is_pre_election: true
I20260807 20:17:33.011759 1341 raft_consensus.cc:2454] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 134c56f4bf3c45c588afd7de05ea4318 in term 0.
I20260807 20:17:33.011787 1460 leader_election.cc:302] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 134c56f4bf3c45c588afd7de05ea4318, 48cf55f0bfc54c0ab9e6d61d4e2054d2; no voters:
I20260807 20:17:33.011907 1887 raft_consensus.cc:2781] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:33.011969 1887 raft_consensus.cc:482] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:33.011998 1887 raft_consensus.cc:3037] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:33.012904 1887 raft_consensus.cc:504] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } }
I20260807 20:17:33.013038 1887 leader_election.cc:288] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [CANDIDATE]: Term 1 election: Requested vote from peers 48cf55f0bfc54c0ab9e6d61d4e2054d2 (127.30.35.195:36241), ad974baaca0e4e15846675a219f45b91 (127.30.35.193:33383)
I20260807 20:17:33.013208 1758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16953170177b48a7aab7a2590de348fc" candidate_uuid: "134c56f4bf3c45c588afd7de05ea4318" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2"
I20260807 20:17:33.013249 1341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16953170177b48a7aab7a2590de348fc" candidate_uuid: "134c56f4bf3c45c588afd7de05ea4318" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad974baaca0e4e15846675a219f45b91"
I20260807 20:17:33.013298 1758 raft_consensus.cc:3037] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:33.013315 1341 raft_consensus.cc:3037] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Advancing to term 1
W20260807 20:17:33.013733 1410 tablet.cc:2369] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:17:33.014098 1341 raft_consensus.cc:2454] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 134c56f4bf3c45c588afd7de05ea4318 in term 1.
I20260807 20:17:33.014163 1758 raft_consensus.cc:2454] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 134c56f4bf3c45c588afd7de05ea4318 in term 1.
I20260807 20:17:33.014286 1458 leader_election.cc:302] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 134c56f4bf3c45c588afd7de05ea4318, ad974baaca0e4e15846675a219f45b91; no voters:
I20260807 20:17:33.014400 1887 raft_consensus.cc:2781] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:33.014578 1887 raft_consensus.cc:686] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [term 1 LEADER]: Becoming Leader. State: Replica: 134c56f4bf3c45c588afd7de05ea4318, State: Running, Role: LEADER
I20260807 20:17:33.014668 1887 consensus_queue.cc:237] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } }
I20260807 20:17:33.015453 1104 catalog_manager.cc:5495] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 reported cstate change: term changed from 0 to 1, leader changed from <none> to 134c56f4bf3c45c588afd7de05ea4318 (127.30.35.194). New cstate: current_term: 1 leader_uuid: "134c56f4bf3c45c588afd7de05ea4318" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } health_report { overall_health: HEALTHY } } }
Aug 07 20:17:33 dist-test-slave-t7g5 krb5kdc[1036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133852, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:33.048658 1904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.042393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40467 (local address 127.0.0.1:48622)
0807 20:17:33.042542 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:33.042553 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:33.042614 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:33.042737 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:33.042738 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:33.043055 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:33.043107 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.043109 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.043705 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.043706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.044267 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.044269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.044583 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.044584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.044629 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.045116 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:33.045120 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:33.046593 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:33.047798 (+ 1205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:33.047805 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:33.047807 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:33.048007 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:33.048152 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:33.048152 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:33.048153 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:33.048203 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:33.048370 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:33.048374 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:33.048411 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 20:17:33.048458 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 20:17:33.048558 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":3,"thread_start_us":71,"threads_started":1}
I20260807 20:17:33.048695 1173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.042436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48622 (local address 127.30.35.254:40467)
0807 20:17:33.042491 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:33.042493 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:33.042606 (+ 113us) server_negotiation.cc:407] Connection header received
0807 20:17:33.042656 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:33.042657 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:33.042666 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:33.042726 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:33.043165 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.043645 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.044333 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.044532 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.044579 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.046679 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:33.046680 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:33.046681 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:33.046687 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:33.047735 (+ 1048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:33.048061 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:33.048062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:33.048062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:33.048109 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:33.048240 (+ 131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:33.048240 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:33.048241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:33.048333 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:33.048379 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:33.048475 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 20:17:33.048603 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":33}
I20260807 20:17:33.050566 1104 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:48622:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 20:17:33.050755 1104 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:33.052052 1311 tablet_service.cc:1467] Processing CreateTablet for tablet dd186d72c2dd438cbd90e70fc1d8c97d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e3d15008fdbd49678d3b48ad41b9080e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 20:17:33.052045 1529 tablet_service.cc:1467] Processing CreateTablet for tablet dd186d72c2dd438cbd90e70fc1d8c97d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e3d15008fdbd49678d3b48ad41b9080e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 20:17:33.052079 1729 tablet_service.cc:1467] Processing CreateTablet for tablet dd186d72c2dd438cbd90e70fc1d8c97d (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e3d15008fdbd49678d3b48ad41b9080e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 20:17:33.052213 1311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd186d72c2dd438cbd90e70fc1d8c97d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:33.052214 1529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd186d72c2dd438cbd90e70fc1d8c97d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:33.052214 1729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd186d72c2dd438cbd90e70fc1d8c97d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:33.053460 1877 tablet_bootstrap.cc:492] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91: Bootstrap starting.
I20260807 20:17:33.053725 1874 tablet_bootstrap.cc:492] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Bootstrap starting.
I20260807 20:17:33.053900 1877 tablet_bootstrap.cc:654] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:33.054260 1874 tablet_bootstrap.cc:654] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:33.054520 1877 tablet_bootstrap.cc:492] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91: No bootstrap required, opened a new log
I20260807 20:17:33.054577 1877 ts_tablet_manager.cc:1397] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:33.054615 1875 tablet_bootstrap.cc:492] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318: Bootstrap starting.
I20260807 20:17:33.054713 1877 raft_consensus.cc:348] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.054788 1877 raft_consensus.cc:374] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:33.054814 1877 raft_consensus.cc:729] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad974baaca0e4e15846675a219f45b91, State: Initialized, Role: FOLLOWER
I20260807 20:17:33.054890 1874 tablet_bootstrap.cc:492] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2: No bootstrap required, opened a new log
I20260807 20:17:33.054881 1877 consensus_queue.cc:260] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.054943 1874 ts_tablet_manager.cc:1397] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:33.055009 1877 ts_tablet_manager.cc:1428] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:33.055073 1874 raft_consensus.cc:348] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.055136 1874 raft_consensus.cc:374] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:33.055162 1874 raft_consensus.cc:729] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48cf55f0bfc54c0ab9e6d61d4e2054d2, State: Initialized, Role: FOLLOWER
I20260807 20:17:33.055141 1888 tablet_replica.cc:439] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } }
I20260807 20:17:33.055205 1888 tablet_replica.cc:442] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:33.055199 1874 consensus_queue.cc:260] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.055274 1874 ts_tablet_manager.cc:1428] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:33.055416 1885 tablet_replica.cc:439] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } }
I20260807 20:17:33.055528 1885 tablet_replica.cc:442] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:33.055950 1875 tablet_bootstrap.cc:654] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:33.056499 1875 tablet_bootstrap.cc:492] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318: No bootstrap required, opened a new log
I20260807 20:17:33.056538 1875 ts_tablet_manager.cc:1397] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:33.056666 1875 raft_consensus.cc:348] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.056730 1875 raft_consensus.cc:374] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:33.056748 1875 raft_consensus.cc:729] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 134c56f4bf3c45c588afd7de05ea4318, State: Initialized, Role: FOLLOWER
I20260807 20:17:33.056797 1875 consensus_queue.cc:260] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.056891 1875 ts_tablet_manager.cc:1428] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:33.056923 1887 tablet_replica.cc:439] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } }
I20260807 20:17:33.056995 1887 tablet_replica.cc:442] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:33.073124 1888 raft_consensus.cc:482] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:33.073235 1888 raft_consensus.cc:504] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.073611 1888 leader_election.cc:288] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 134c56f4bf3c45c588afd7de05ea4318 (127.30.35.194:39453), 48cf55f0bfc54c0ab9e6d61d4e2054d2 (127.30.35.195:36241)
I20260807 20:17:33.077003 1872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.073838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:40451 (local address 127.30.35.195:36241)
0807 20:17:33.073939 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:33.073941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:33.074030 (+ 89us) server_negotiation.cc:407] Connection header received
0807 20:17:33.074091 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:33.074092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:33.074101 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:33.074159 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:33.074337 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.075089 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.076364 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.076727 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.076780 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.076789 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:33.076911 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 20:17:33.076947 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 20:17:33.077045 1915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.073780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:36241 (local address 127.30.35.193:40451)
0807 20:17:33.073966 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:33.073974 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:33.074035 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:33.074168 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:33.074169 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:33.074171 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:33.074271 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.074273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.075166 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.075167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.076296 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.076299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.076795 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.076796 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.076855 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.076860 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:17:33.076906 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 20:17:33.076947 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":116,"thread_start_us":59,"threads_started":1}
I20260807 20:17:33.077245 1758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd186d72c2dd438cbd90e70fc1d8c97d" candidate_uuid: "ad974baaca0e4e15846675a219f45b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" is_pre_election: true
I20260807 20:17:33.077330 1758 raft_consensus.cc:2454] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad974baaca0e4e15846675a219f45b91 in term 0.
I20260807 20:17:33.077492 1240 leader_election.cc:302] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48cf55f0bfc54c0ab9e6d61d4e2054d2, ad974baaca0e4e15846675a219f45b91; no voters:
I20260807 20:17:33.077644 1888 raft_consensus.cc:2781] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:33.077705 1888 raft_consensus.cc:482] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:33.077728 1888 raft_consensus.cc:3037] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:33.078521 1888 raft_consensus.cc:504] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.078650 1888 leader_election.cc:288] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [CANDIDATE]: Term 1 election: Requested vote from peers 134c56f4bf3c45c588afd7de05ea4318 (127.30.35.194:39453), 48cf55f0bfc54c0ab9e6d61d4e2054d2 (127.30.35.195:36241)
I20260807 20:17:33.078821 1758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd186d72c2dd438cbd90e70fc1d8c97d" candidate_uuid: "ad974baaca0e4e15846675a219f45b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2"
I20260807 20:17:33.078924 1758 raft_consensus.cc:3037] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:33.078965 1873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.073852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:37779 (local address 127.30.35.194:39453)
0807 20:17:33.073963 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:33.073965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:33.074033 (+ 68us) server_negotiation.cc:407] Connection header received
0807 20:17:33.074091 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:33.074091 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:33.074100 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:33.074159 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:33.074333 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.075078 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.078229 (+ 3151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.078607 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.078678 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.078688 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:33.078859 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 20:17:33.078896 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 20:17:33.078977 1912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.073780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:39453 (local address 127.30.35.193:37779)
0807 20:17:33.073954 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:33.073966 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:33.074036 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:33.074168 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:33.074169 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:33.074173 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:33.074271 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.074273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.075165 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.075166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.078147 (+ 2981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.078149 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.078722 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.078723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.078792 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.078797 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:17:33.078840 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 20:17:33.078879 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":57,"thread_start_us":107,"threads_started":1}
I20260807 20:17:33.079391 1552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd186d72c2dd438cbd90e70fc1d8c97d" candidate_uuid: "ad974baaca0e4e15846675a219f45b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "134c56f4bf3c45c588afd7de05ea4318" is_pre_election: true
I20260807 20:17:33.079397 1550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd186d72c2dd438cbd90e70fc1d8c97d" candidate_uuid: "ad974baaca0e4e15846675a219f45b91" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "134c56f4bf3c45c588afd7de05ea4318"
I20260807 20:17:33.079509 1552 raft_consensus.cc:2454] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad974baaca0e4e15846675a219f45b91 in term 0.
I20260807 20:17:33.079668 1758 raft_consensus.cc:2454] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad974baaca0e4e15846675a219f45b91 in term 1.
I20260807 20:17:33.079841 1240 leader_election.cc:302] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48cf55f0bfc54c0ab9e6d61d4e2054d2, ad974baaca0e4e15846675a219f45b91; no voters: 134c56f4bf3c45c588afd7de05ea4318
I20260807 20:17:33.079943 1888 raft_consensus.cc:2781] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:33.080081 1888 raft_consensus.cc:686] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [term 1 LEADER]: Becoming Leader. State: Replica: ad974baaca0e4e15846675a219f45b91, State: Running, Role: LEADER
I20260807 20:17:33.080180 1888 consensus_queue.cc:237] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.080616 1916 tablet_replica.cc:439] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91: TxnStatusTablet state changed. Reason: New leader ad974baaca0e4e15846675a219f45b91. Latest consensus state: current_term: 1 leader_uuid: "ad974baaca0e4e15846675a219f45b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } }
I20260807 20:17:33.080708 1916 tablet_replica.cc:442] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91: This TxnStatusTablet replica's current role is: LEADER
I20260807 20:17:33.080917 1104 catalog_manager.cc:5495] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad974baaca0e4e15846675a219f45b91 (127.30.35.193). New cstate: current_term: 1 leader_uuid: "ad974baaca0e4e15846675a219f45b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } health_report { overall_health: UNKNOWN } } }
I20260807 20:17:33.081218 1920 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 20:17:33.081332 1920 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 20:17:33.092531 1871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.090181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34400 (local address 127.30.35.193:33383)
0807 20:17:33.090235 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:33.090237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:33.090246 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:33.090340 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:33.090341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:33.090358 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:33.090412 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:33.090540 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.091038 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.091757 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.091958 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.092013 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.092184 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:33.092284 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:33.092350 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:33.092415 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 20:17:33.092437 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 20:17:33.092523 1904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.090124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:33383 (local address 127.0.0.1:34400)
0807 20:17:33.090202 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:33.090215 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:33.090265 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:33.090433 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:33.090434 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:33.090436 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 20:17:33.090486 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.090488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.091109 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.091111 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.091686 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.091688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.092018 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.092019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.092088 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.092103 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 20:17:33.092337 (+ 234us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 20:17:33.092347 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 20:17:33.092397 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 20:17:33.092450 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
W20260807 20:17:33.093124 1836 tablet.cc:2369] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:17:33.094462 1758 raft_consensus.cc:1261] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Refusing update from remote peer ad974baaca0e4e15846675a219f45b91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:33.094445 1550 raft_consensus.cc:3037] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:33.094738 1916 consensus_queue.cc:1035] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:33.095377 1550 raft_consensus.cc:1261] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Refusing update from remote peer ad974baaca0e4e15846675a219f45b91: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:33.095669 1916 consensus_queue.cc:1035] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:33.096071 1885 tablet_replica.cc:439] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2: TxnStatusTablet state changed. Reason: New leader ad974baaca0e4e15846675a219f45b91. Latest consensus state: current_term: 1 leader_uuid: "ad974baaca0e4e15846675a219f45b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } }
I20260807 20:17:33.096158 1885 tablet_replica.cc:442] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:33.096804 1887 tablet_replica.cc:439] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318: TxnStatusTablet state changed. Reason: New leader ad974baaca0e4e15846675a219f45b91. Latest consensus state: current_term: 1 leader_uuid: "ad974baaca0e4e15846675a219f45b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } }
I20260807 20:17:33.096890 1887 tablet_replica.cc:442] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:33.097249 1924 mvcc.cc:205] Tried to move back new op lower bound from 7316004262272561152 to 7316004262217031680. Current Snapshot: MvccSnapshot[applied={T|T < 7316004262272561152}]
I20260807 20:17:33.097333 1888 tablet_replica.cc:439] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ad974baaca0e4e15846675a219f45b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } }
I20260807 20:17:33.097393 1888 tablet_replica.cc:442] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91: This TxnStatusTablet replica's current role is: LEADER
I20260807 20:17:33.097396 1885 tablet_replica.cc:439] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ad974baaca0e4e15846675a219f45b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } }
I20260807 20:17:33.097484 1885 tablet_replica.cc:442] T dd186d72c2dd438cbd90e70fc1d8c97d P 48cf55f0bfc54c0ab9e6d61d4e2054d2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:33.097908 1925 mvcc.cc:205] Tried to move back new op lower bound from 7316004262272561152 to 7316004262217031680. Current Snapshot: MvccSnapshot[applied={T|T < 7316004262272561152}]
I20260807 20:17:33.098917 1931 tablet_replica.cc:439] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ad974baaca0e4e15846675a219f45b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } }
I20260807 20:17:33.099046 1931 tablet_replica.cc:442] T dd186d72c2dd438cbd90e70fc1d8c97d P ad974baaca0e4e15846675a219f45b91: This TxnStatusTablet replica's current role is: LEADER
I20260807 20:17:33.099323 1887 tablet_replica.cc:439] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ad974baaca0e4e15846675a219f45b91" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } } }
I20260807 20:17:33.099398 1887 tablet_replica.cc:442] T dd186d72c2dd438cbd90e70fc1d8c97d P 134c56f4bf3c45c588afd7de05ea4318: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:33.102679 1873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.100129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51860 (local address 127.30.35.194:39453)
0807 20:17:33.100172 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:33.100174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:33.100181 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:17:33.100211 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:33.100211 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:33.100228 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:33.100294 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:33.100437 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.101154 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.101925 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.102227 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.102288 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.102377 (+ 89us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:33.102502 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:33.102576 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:33.102590 (+ 14us) server_negotiation.cc:299] Negotiation successful
0807 20:17:33.102610 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 20:17:33.107393 1871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.105023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:52301 (local address 127.30.35.193:33383)
0807 20:17:33.105061 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:33.105063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:33.105070 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:17:33.105134 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:33.105135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:33.105142 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:33.105182 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:33.105294 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.105764 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.106809 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.106991 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.107039 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.107222 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:33.107245 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:33.107276 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:33.107327 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 20:17:33.107342 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 20:17:33.107445 1635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.104961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:33383 (local address 127.30.35.194:52301)
0807 20:17:33.105023 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:33.105035 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:33.105077 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:33.105185 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:33.105186 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:33.105187 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 20:17:33.105242 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.105243 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.105823 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.105823 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.106733 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.106736 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.107053 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.107054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.107119 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.107135 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 20:17:33.107280 (+ 145us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 20:17:33.107281 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 20:17:33.107325 (+ 44us) client_negotiation.cc:240] Negotiation successful
0807 20:17:33.107365 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 20:17:33.109763 1758 raft_consensus.cc:1261] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Refusing update from remote peer 134c56f4bf3c45c588afd7de05ea4318: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:33.109774 1341 raft_consensus.cc:1261] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Refusing update from remote peer 134c56f4bf3c45c588afd7de05ea4318: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:33.110023 1893 consensus_queue.cc:1035] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:33.110148 1887 consensus_queue.cc:1035] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:33.118857 1947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.116148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:39453 (local address 127.30.35.193:57279)
0807 20:17:33.116318 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:33.116329 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:33.116392 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:33.116509 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:33.116509 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:33.116511 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 20:17:33.116562 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.116563 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.117400 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.117401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.118079 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.118081 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.118522 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.118522 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.118572 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.118585 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 20:17:33.118734 (+ 149us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 20:17:33.118734 (+ 0us) client_negotiation.cc:769] Sending connection context
0807 20:17:33.118760 (+ 26us) client_negotiation.cc:240] Negotiation successful
0807 20:17:33.118792 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":106,"threads_started":1}
I20260807 20:17:33.118854 1873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.116192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:57279 (local address 127.30.35.194:39453)
0807 20:17:33.116234 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:33.116235 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:33.116394 (+ 159us) server_negotiation.cc:407] Connection header received
0807 20:17:33.116439 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:33.116439 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:33.116449 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:33.116508 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:33.116596 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.117333 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.118153 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.118457 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.118518 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.118657 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:33.118688 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:33.118734 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:33.118765 (+ 31us) server_negotiation.cc:299] Negotiation successful
0807 20:17:33.118783 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:17:33.128245 1104 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:33.128371 1104 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:33.129092 1104 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678: Sending DeleteTablet for 3 replicas of tablet 16953170177b48a7aab7a2590de348fc
I20260807 20:17:33.129401 1311 tablet_service.cc:1514] Processing DeleteTablet for tablet 16953170177b48a7aab7a2590de348fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:33 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:34388
I20260807 20:17:33.129426 1729 tablet_service.cc:1514] Processing DeleteTablet for tablet 16953170177b48a7aab7a2590de348fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:33 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:36832
I20260807 20:17:33.129734 1954 tablet_replica.cc:330] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2: stopping tablet replica
I20260807 20:17:33.129844 1954 raft_consensus.cc:2229] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:33.129851 1529 tablet_service.cc:1514] Processing DeleteTablet for tablet 16953170177b48a7aab7a2590de348fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:33 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:51850
I20260807 20:17:33.129930 1954 raft_consensus.cc:2258] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:33.130095 1956 tablet_replica.cc:330] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318: stopping tablet replica
I20260807 20:17:33.130198 1956 raft_consensus.cc:2229] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:17:33.130311 1956 raft_consensus.cc:2258] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:33.130321 1104 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:17:33.130461 1104 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:33.130582 1954 ts_tablet_manager.cc:1905] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:33.131719 1729 tablet_service.cc:1467] Processing CreateTablet for tablet d4dba81065954cd5a2c8e899348c84ea (DEFAULT_TABLE table=test-table [id=538e314e41b148138b92248b4717e0b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:33.131837 1729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4dba81065954cd5a2c8e899348c84ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:33.132268 1954 ts_tablet_manager.cc:1918] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 20:17:33.132332 1954 log.cc:1196] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/16953170177b48a7aab7a2590de348fc
I20260807 20:17:33.132607 1954 ts_tablet_manager.cc:1939] T 16953170177b48a7aab7a2590de348fc P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Deleting consensus metadata
I20260807 20:17:33.132999 1085 catalog_manager.cc:4841] TS 48cf55f0bfc54c0ab9e6d61d4e2054d2 (127.30.35.195:36241): tablet 16953170177b48a7aab7a2590de348fc (table test-table [id=5b29aaa6f79f42a7996ff81afe309551]) successfully deleted
I20260807 20:17:33.133044 1874 tablet_bootstrap.cc:492] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Bootstrap starting.
I20260807 20:17:33.133157 1952 tablet_replica.cc:330] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91: stopping tablet replica
I20260807 20:17:33.133246 1952 raft_consensus.cc:2229] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:33.133301 1952 raft_consensus.cc:2258] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:33.133424 1874 tablet_bootstrap.cc:654] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:33.133683 1952 ts_tablet_manager.cc:1905] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:33.133821 1956 ts_tablet_manager.cc:1905] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:33.133905 1311 tablet_service.cc:1467] Processing CreateTablet for tablet d4dba81065954cd5a2c8e899348c84ea (DEFAULT_TABLE table=test-table [id=538e314e41b148138b92248b4717e0b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:33.134008 1311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4dba81065954cd5a2c8e899348c84ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:33.135234 1877 tablet_bootstrap.cc:492] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91: Bootstrap starting.
I20260807 20:17:33.135296 1952 ts_tablet_manager.cc:1918] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 20:17:33.135313 1956 ts_tablet_manager.cc:1918] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 20:17:33.135365 1952 log.cc:1196] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/wal/wals/16953170177b48a7aab7a2590de348fc
I20260807 20:17:33.135365 1956 log.cc:1196] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/16953170177b48a7aab7a2590de348fc
I20260807 20:17:33.135627 1956 ts_tablet_manager.cc:1939] T 16953170177b48a7aab7a2590de348fc P 134c56f4bf3c45c588afd7de05ea4318: Deleting consensus metadata
I20260807 20:17:33.135623 1877 tablet_bootstrap.cc:654] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:33.135634 1952 ts_tablet_manager.cc:1939] T 16953170177b48a7aab7a2590de348fc P ad974baaca0e4e15846675a219f45b91: Deleting consensus metadata
I20260807 20:17:33.136036 1874 tablet_bootstrap.cc:492] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2: No bootstrap required, opened a new log
I20260807 20:17:33.136076 1874 ts_tablet_manager.cc:1397] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 20:17:33.136205 1874 raft_consensus.cc:348] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.136238 1083 catalog_manager.cc:4841] TS ad974baaca0e4e15846675a219f45b91 (127.30.35.193:33383): tablet 16953170177b48a7aab7a2590de348fc (table test-table [id=5b29aaa6f79f42a7996ff81afe309551]) successfully deleted
I20260807 20:17:33.136269 1874 raft_consensus.cc:374] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:33.136289 1874 raft_consensus.cc:729] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48cf55f0bfc54c0ab9e6d61d4e2054d2, State: Initialized, Role: FOLLOWER
I20260807 20:17:33.136327 1874 consensus_queue.cc:260] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.136410 1874 ts_tablet_manager.cc:1428] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:33.136433 1084 catalog_manager.cc:4841] TS 134c56f4bf3c45c588afd7de05ea4318 (127.30.35.194:39453): tablet 16953170177b48a7aab7a2590de348fc (table test-table [id=5b29aaa6f79f42a7996ff81afe309551]) successfully deleted
I20260807 20:17:33.136593 1529 tablet_service.cc:1467] Processing CreateTablet for tablet d4dba81065954cd5a2c8e899348c84ea (DEFAULT_TABLE table=test-table [id=538e314e41b148138b92248b4717e0b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:33.136698 1529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4dba81065954cd5a2c8e899348c84ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:33.137867 1875 tablet_bootstrap.cc:492] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318: Bootstrap starting.
I20260807 20:17:33.138237 1875 tablet_bootstrap.cc:654] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:33.138280 1877 tablet_bootstrap.cc:492] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91: No bootstrap required, opened a new log
I20260807 20:17:33.138321 1877 ts_tablet_manager.cc:1397] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.000s
I20260807 20:17:33.138453 1877 raft_consensus.cc:348] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.138512 1877 raft_consensus.cc:374] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:33.138531 1877 raft_consensus.cc:729] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad974baaca0e4e15846675a219f45b91, State: Initialized, Role: FOLLOWER
I20260807 20:17:33.138571 1877 consensus_queue.cc:260] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.138643 1877 ts_tablet_manager.cc:1428] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:33.139485 1875 tablet_bootstrap.cc:492] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318: No bootstrap required, opened a new log
I20260807 20:17:33.139533 1875 ts_tablet_manager.cc:1397] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:33.139658 1875 raft_consensus.cc:348] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.139714 1875 raft_consensus.cc:374] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:33.139731 1875 raft_consensus.cc:729] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 134c56f4bf3c45c588afd7de05ea4318, State: Initialized, Role: FOLLOWER
I20260807 20:17:33.139770 1875 consensus_queue.cc:260] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.139853 1875 ts_tablet_manager.cc:1428] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:33.503475 1885 raft_consensus.cc:482] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:33.503594 1885 raft_consensus.cc:504] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.504060 1885 leader_election.cc:288] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad974baaca0e4e15846675a219f45b91 (127.30.35.193:33383), 134c56f4bf3c45c588afd7de05ea4318 (127.30.35.194:39453)
I20260807 20:17:33.507995 1871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.504256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:47135 (local address 127.30.35.193:33383)
0807 20:17:33.504320 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:33.504322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:33.504426 (+ 104us) server_negotiation.cc:407] Connection header received
0807 20:17:33.504604 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:33.504605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:33.504618 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:33.504672 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:33.504923 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.505581 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.507071 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.507632 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.507709 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.507718 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:33.507880 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 20:17:33.507921 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 20:17:33.507995 1873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.504335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:45623 (local address 127.30.35.194:39453)
0807 20:17:33.504377 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:33.504379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:33.504410 (+ 31us) server_negotiation.cc:407] Connection header received
0807 20:17:33.504483 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:33.504484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:33.504498 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:33.504550 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:33.504700 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.505408 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.507071 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.507632 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.507712 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.507719 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:33.507886 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 20:17:33.507927 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 20:17:33.508028 1964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.504192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:33383 (local address 127.30.35.195:47135)
0807 20:17:33.504339 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:33.504352 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:33.504426 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:33.504748 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:33.504749 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:33.504752 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:33.504840 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.504841 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.505683 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.505684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.506953 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.506957 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.507720 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.507720 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.507807 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.507814 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 20:17:33.507865 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 20:17:33.507915 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":33,"thread_start_us":66,"threads_started":1}
I20260807 20:17:33.508028 1961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.504236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:39453 (local address 127.30.35.195:45623)
0807 20:17:33.504356 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:33.504364 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:33.504426 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:33.504560 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:33.504561 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:33.504563 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:33.504632 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.504633 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.505587 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.505588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.506961 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.506963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.507717 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.507718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.507807 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.507813 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 20:17:33.507871 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 20:17:33.507915 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":57,"thread_start_us":62,"threads_started":1}
I20260807 20:17:33.508419 1341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4dba81065954cd5a2c8e899348c84ea" candidate_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad974baaca0e4e15846675a219f45b91" is_pre_election: true
I20260807 20:17:33.508440 1550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4dba81065954cd5a2c8e899348c84ea" candidate_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "134c56f4bf3c45c588afd7de05ea4318" is_pre_election: true
I20260807 20:17:33.508526 1550 raft_consensus.cc:2454] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48cf55f0bfc54c0ab9e6d61d4e2054d2 in term 0.
I20260807 20:17:33.508522 1341 raft_consensus.cc:2454] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48cf55f0bfc54c0ab9e6d61d4e2054d2 in term 0.
I20260807 20:17:33.508699 1660 leader_election.cc:302] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48cf55f0bfc54c0ab9e6d61d4e2054d2, ad974baaca0e4e15846675a219f45b91; no voters:
I20260807 20:17:33.508888 1885 raft_consensus.cc:2781] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:33.508944 1885 raft_consensus.cc:482] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:33.508957 1885 raft_consensus.cc:3037] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:33.509606 1885 raft_consensus.cc:504] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.509752 1885 leader_election.cc:288] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [CANDIDATE]: Term 1 election: Requested vote from peers ad974baaca0e4e15846675a219f45b91 (127.30.35.193:33383), 134c56f4bf3c45c588afd7de05ea4318 (127.30.35.194:39453)
I20260807 20:17:33.509898 1341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4dba81065954cd5a2c8e899348c84ea" candidate_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad974baaca0e4e15846675a219f45b91"
I20260807 20:17:33.509908 1550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4dba81065954cd5a2c8e899348c84ea" candidate_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "134c56f4bf3c45c588afd7de05ea4318"
I20260807 20:17:33.509979 1550 raft_consensus.cc:3037] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:33.509975 1341 raft_consensus.cc:3037] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:33.510561 1341 raft_consensus.cc:2454] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48cf55f0bfc54c0ab9e6d61d4e2054d2 in term 1.
I20260807 20:17:33.510601 1550 raft_consensus.cc:2454] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48cf55f0bfc54c0ab9e6d61d4e2054d2 in term 1.
I20260807 20:17:33.510753 1661 leader_election.cc:302] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 134c56f4bf3c45c588afd7de05ea4318, 48cf55f0bfc54c0ab9e6d61d4e2054d2; no voters:
I20260807 20:17:33.510866 1885 raft_consensus.cc:2781] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:33.510991 1885 raft_consensus.cc:686] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 LEADER]: Becoming Leader. State: Replica: 48cf55f0bfc54c0ab9e6d61d4e2054d2, State: Running, Role: LEADER
I20260807 20:17:33.511065 1885 consensus_queue.cc:237] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:33.511765 1104 catalog_manager.cc:5495] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48cf55f0bfc54c0ab9e6d61d4e2054d2 (127.30.35.195). New cstate: current_term: 1 leader_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } health_report { overall_health: HEALTHY } } }
I20260807 20:17:33.581429 1967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.579310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36844 (local address 127.30.35.195:36241)
0807 20:17:33.579420 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:33.579422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:33.579430 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:33.579467 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:33.579467 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:33.579487 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:33.579561 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:33.579646 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.580145 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.580824 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.581006 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.581048 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.581139 (+ 91us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:33.581246 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:33.581311 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:33.581324 (+ 13us) server_negotiation.cc:299] Negotiation successful
0807 20:17:33.581340 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":59,"threads_started":1}
I20260807 20:17:33.586591 1871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.583986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:49859 (local address 127.30.35.193:33383)
0807 20:17:33.584029 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:33.584031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:33.584119 (+ 88us) server_negotiation.cc:407] Connection header received
0807 20:17:33.584159 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:33.584160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:33.584169 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:33.584214 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:33.584328 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.584773 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.585964 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.586141 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.586191 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.586407 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:33.586430 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:33.586460 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:33.586517 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 20:17:33.586531 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 20:17:33.586630 1973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.583919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:33383 (local address 127.30.35.195:49859)
0807 20:17:33.584058 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:33.584070 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:33.584120 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:33.584215 (+ 95us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:33.584216 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:33.584217 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 20:17:33.584288 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.584289 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.584837 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.584838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.585905 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.585909 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.586246 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.586248 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.586306 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.586321 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 20:17:33.586470 (+ 149us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 20:17:33.586471 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 20:17:33.586513 (+ 42us) client_negotiation.cc:240] Negotiation successful
0807 20:17:33.586552 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260807 20:17:33.588716 1550 raft_consensus.cc:1261] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Refusing update from remote peer 48cf55f0bfc54c0ab9e6d61d4e2054d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:33.588739 1341 raft_consensus.cc:1261] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Refusing update from remote peer 48cf55f0bfc54c0ab9e6d61d4e2054d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:33.589001 1885 consensus_queue.cc:1035] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:33.589182 1965 consensus_queue.cc:1035] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:33.596880 1967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.594714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:50907 (local address 127.30.35.195:36241)
0807 20:17:33.594755 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:33.594758 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:33.594766 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:33.594820 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:33.594821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:33.594834 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:33.594906 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:33.595011 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.595510 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.596195 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.596379 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.596433 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.596566 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:33.596600 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:33.596655 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:33.596787 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 20:17:33.596812 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 20:17:33.596894 1947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:33.594661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:36241 (local address 127.30.35.193:50907)
0807 20:17:33.594714 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:33.594725 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:33.594765 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:33.594915 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:33.594916 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:33.594917 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 20:17:33.594962 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.594963 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.595577 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.595578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.596126 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:33.596128 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:33.596433 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:33.596434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:33.596495 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:33.596503 (+ 8us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 20:17:33.596683 (+ 180us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 20:17:33.596686 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:33.596779 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 20:17:33.596831 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 20:17:33.597223 1925 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 20:17:35.115582 1103 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:35.115679 1103 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:35.116434 1103 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678: Sending DeleteTablet for 3 replicas of tablet d4dba81065954cd5a2c8e899348c84ea
I20260807 20:17:35.116655 1311 tablet_service.cc:1514] Processing DeleteTablet for tablet d4dba81065954cd5a2c8e899348c84ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:35 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:34388
I20260807 20:17:35.116719 1729 tablet_service.cc:1514] Processing DeleteTablet for tablet d4dba81065954cd5a2c8e899348c84ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:35 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:36832
I20260807 20:17:35.116848 1529 tablet_service.cc:1514] Processing DeleteTablet for tablet d4dba81065954cd5a2c8e899348c84ea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:35 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:51850
I20260807 20:17:35.116937 2012 tablet_replica.cc:330] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2: stopping tablet replica
I20260807 20:17:35.116991 2012 raft_consensus.cc:2229] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:17:35.117084 2011 tablet_replica.cc:330] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91: stopping tablet replica
I20260807 20:17:35.117115 2012 raft_consensus.cc:2258] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:35.117146 2011 raft_consensus.cc:2229] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:35.117242 2014 tablet_replica.cc:330] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318: stopping tablet replica
I20260807 20:17:35.117300 2014 raft_consensus.cc:2229] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:35.117338 2014 raft_consensus.cc:2258] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:35.117388 2012 ts_tablet_manager.cc:1905] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:35.117403 2011 raft_consensus.cc:2258] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:35.117674 2014 ts_tablet_manager.cc:1905] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:35.117899 2011 ts_tablet_manager.cc:1905] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:35.119181 2012 ts_tablet_manager.cc:1918] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 20:17:35.119248 2012 log.cc:1196] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/d4dba81065954cd5a2c8e899348c84ea
I20260807 20:17:35.119505 2012 ts_tablet_manager.cc:1939] T d4dba81065954cd5a2c8e899348c84ea P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Deleting consensus metadata
I20260807 20:17:35.119791 1085 catalog_manager.cc:4841] TS 48cf55f0bfc54c0ab9e6d61d4e2054d2 (127.30.35.195:36241): tablet d4dba81065954cd5a2c8e899348c84ea (table test-table [id=538e314e41b148138b92248b4717e0b5]) successfully deleted
I20260807 20:17:35.120610 2011 ts_tablet_manager.cc:1918] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 20:17:35.120658 2011 log.cc:1196] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/wal/wals/d4dba81065954cd5a2c8e899348c84ea
I20260807 20:17:35.120767 2014 ts_tablet_manager.cc:1918] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 20:17:35.120823 2014 log.cc:1196] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/d4dba81065954cd5a2c8e899348c84ea
I20260807 20:17:35.120846 2011 ts_tablet_manager.cc:1939] T d4dba81065954cd5a2c8e899348c84ea P ad974baaca0e4e15846675a219f45b91: Deleting consensus metadata
I20260807 20:17:35.121011 2014 ts_tablet_manager.cc:1939] T d4dba81065954cd5a2c8e899348c84ea P 134c56f4bf3c45c588afd7de05ea4318: Deleting consensus metadata
I20260807 20:17:35.121137 1083 catalog_manager.cc:4841] TS ad974baaca0e4e15846675a219f45b91 (127.30.35.193:33383): tablet d4dba81065954cd5a2c8e899348c84ea (table test-table [id=538e314e41b148138b92248b4717e0b5]) successfully deleted
I20260807 20:17:35.121279 1084 catalog_manager.cc:4841] TS 134c56f4bf3c45c588afd7de05ea4318 (127.30.35.194:39453): tablet d4dba81065954cd5a2c8e899348c84ea (table test-table [id=538e314e41b148138b92248b4717e0b5]) successfully deleted
Aug 07 20:17:35 dist-test-slave-t7g5 krb5kdc[1036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133855, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 20:17:35 dist-test-slave-t7g5 krb5kdc[1036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133855, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:35.144690 2022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:35.134527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44020 (local address 127.30.35.254:40467)
0807 20:17:35.134647 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:35.134650 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:35.134683 (+ 33us) server_negotiation.cc:407] Connection header received
0807 20:17:35.134749 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:35.134750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:35.134760 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:35.134816 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:35.135382 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:35.135889 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:35.136584 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:35.136765 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:35.136805 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:35.142503 (+ 5698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:35.142505 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:35.142505 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:35.142512 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:35.143839 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:35.144115 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:35.144116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:35.144116 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:35.144174 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:35.144291 (+ 117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:35.144291 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:35.144292 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:35.144396 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:35.144465 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:35.144547 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 20:17:35.144614 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":73,"threads_started":1}
I20260807 20:17:35.146143 1103 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44020:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:17:35.146291 1103 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:35.147488 1311 tablet_service.cc:1467] Processing CreateTablet for tablet 97bbfa3836f14cf8aee57caf253bbe32 (DEFAULT_TABLE table=test-table [id=bf5740d67e244ebf866ea2284ad4d94b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:35.147532 1729 tablet_service.cc:1467] Processing CreateTablet for tablet 97bbfa3836f14cf8aee57caf253bbe32 (DEFAULT_TABLE table=test-table [id=bf5740d67e244ebf866ea2284ad4d94b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:35.147636 1311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97bbfa3836f14cf8aee57caf253bbe32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:35.147651 1729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97bbfa3836f14cf8aee57caf253bbe32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:35.148638 2023 tablet_bootstrap.cc:492] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Bootstrap starting.
I20260807 20:17:35.148646 2027 tablet_bootstrap.cc:492] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91: Bootstrap starting.
I20260807 20:17:35.148675 1529 tablet_service.cc:1467] Processing CreateTablet for tablet 97bbfa3836f14cf8aee57caf253bbe32 (DEFAULT_TABLE table=test-table [id=bf5740d67e244ebf866ea2284ad4d94b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:35.148798 1529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97bbfa3836f14cf8aee57caf253bbe32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:35.149009 2023 tablet_bootstrap.cc:654] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:35.149013 2027 tablet_bootstrap.cc:654] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:35.149572 2027 tablet_bootstrap.cc:492] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91: No bootstrap required, opened a new log
I20260807 20:17:35.149617 2027 ts_tablet_manager.cc:1397] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:35.149760 2027 raft_consensus.cc:348] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.149822 2027 raft_consensus.cc:374] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:35.149842 2027 raft_consensus.cc:729] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad974baaca0e4e15846675a219f45b91, State: Initialized, Role: FOLLOWER
I20260807 20:17:35.149873 2027 consensus_queue.cc:260] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.150075 2030 tablet_bootstrap.cc:492] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318: Bootstrap starting.
I20260807 20:17:35.150398 2027 ts_tablet_manager.cc:1428] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:35.150442 2030 tablet_bootstrap.cc:654] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:35.150455 2023 tablet_bootstrap.cc:492] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: No bootstrap required, opened a new log
I20260807 20:17:35.150499 2023 ts_tablet_manager.cc:1397] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:35.150630 2023 raft_consensus.cc:348] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.150761 2023 raft_consensus.cc:374] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:35.150826 2023 raft_consensus.cc:729] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48cf55f0bfc54c0ab9e6d61d4e2054d2, State: Initialized, Role: FOLLOWER
I20260807 20:17:35.150892 2023 consensus_queue.cc:260] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.150997 2023 ts_tablet_manager.cc:1428] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:35.151069 2030 tablet_bootstrap.cc:492] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318: No bootstrap required, opened a new log
I20260807 20:17:35.151120 2030 ts_tablet_manager.cc:1397] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:35.151221 2030 raft_consensus.cc:348] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.151286 2030 raft_consensus.cc:374] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:35.151314 2030 raft_consensus.cc:729] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 134c56f4bf3c45c588afd7de05ea4318, State: Initialized, Role: FOLLOWER
I20260807 20:17:35.151368 2030 consensus_queue.cc:260] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.151551 2030 ts_tablet_manager.cc:1428] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:35.283298 2000 raft_consensus.cc:482] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:35.283412 2000 raft_consensus.cc:504] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.283599 2000 leader_election.cc:288] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad974baaca0e4e15846675a219f45b91 (127.30.35.193:33383), 134c56f4bf3c45c588afd7de05ea4318 (127.30.35.194:39453)
I20260807 20:17:35.283834 1550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97bbfa3836f14cf8aee57caf253bbe32" candidate_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "134c56f4bf3c45c588afd7de05ea4318" is_pre_election: true
I20260807 20:17:35.283834 1341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97bbfa3836f14cf8aee57caf253bbe32" candidate_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad974baaca0e4e15846675a219f45b91" is_pre_election: true
I20260807 20:17:35.283952 1550 raft_consensus.cc:2454] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48cf55f0bfc54c0ab9e6d61d4e2054d2 in term 0.
I20260807 20:17:35.283972 1341 raft_consensus.cc:2454] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48cf55f0bfc54c0ab9e6d61d4e2054d2 in term 0.
I20260807 20:17:35.284133 1661 leader_election.cc:302] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 134c56f4bf3c45c588afd7de05ea4318, 48cf55f0bfc54c0ab9e6d61d4e2054d2; no voters:
I20260807 20:17:35.284236 2000 raft_consensus.cc:2781] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:35.284271 2000 raft_consensus.cc:482] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:35.284283 2000 raft_consensus.cc:3037] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:35.284999 2000 raft_consensus.cc:504] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.285120 2000 leader_election.cc:288] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [CANDIDATE]: Term 1 election: Requested vote from peers ad974baaca0e4e15846675a219f45b91 (127.30.35.193:33383), 134c56f4bf3c45c588afd7de05ea4318 (127.30.35.194:39453)
I20260807 20:17:35.285264 1341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97bbfa3836f14cf8aee57caf253bbe32" candidate_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad974baaca0e4e15846675a219f45b91"
I20260807 20:17:35.285334 1341 raft_consensus.cc:3037] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:35.285729 1550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97bbfa3836f14cf8aee57caf253bbe32" candidate_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "134c56f4bf3c45c588afd7de05ea4318"
I20260807 20:17:35.285804 1550 raft_consensus.cc:3037] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:35.285988 1341 raft_consensus.cc:2454] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48cf55f0bfc54c0ab9e6d61d4e2054d2 in term 1.
I20260807 20:17:35.286154 1660 leader_election.cc:302] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48cf55f0bfc54c0ab9e6d61d4e2054d2, ad974baaca0e4e15846675a219f45b91; no voters:
I20260807 20:17:35.286247 2000 raft_consensus.cc:2781] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:35.286317 2000 raft_consensus.cc:686] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 LEADER]: Becoming Leader. State: Replica: 48cf55f0bfc54c0ab9e6d61d4e2054d2, State: Running, Role: LEADER
I20260807 20:17:35.286381 2000 consensus_queue.cc:237] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.286559 1550 raft_consensus.cc:2454] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48cf55f0bfc54c0ab9e6d61d4e2054d2 in term 1.
I20260807 20:17:35.287047 1104 catalog_manager.cc:5495] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48cf55f0bfc54c0ab9e6d61d4e2054d2 (127.30.35.195). New cstate: current_term: 1 leader_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } health_report { overall_health: HEALTHY } } }
I20260807 20:17:35.299705 2039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:35.297491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49346 (local address 127.30.35.195:36241)
0807 20:17:35.297667 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:35.297670 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:35.297678 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:35.297701 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:35.297701 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:35.297712 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:35.297773 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:35.297909 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:35.298385 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:35.299125 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:35.299313 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:35.299358 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:35.299529 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:35.299558 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:35.299589 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:35.299619 (+ 30us) server_negotiation.cc:299] Negotiation successful
0807 20:17:35.299636 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":110,"threads_started":1}
I20260807 20:17:35.301614 1550 raft_consensus.cc:1261] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Refusing update from remote peer 48cf55f0bfc54c0ab9e6d61d4e2054d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:35.301692 1341 raft_consensus.cc:1261] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Refusing update from remote peer 48cf55f0bfc54c0ab9e6d61d4e2054d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:35.301869 2000 consensus_queue.cc:1035] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:35.301990 1980 consensus_queue.cc:1035] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:35.303401 1990 mvcc.cc:205] Tried to move back new op lower bound from 7316004271314288640 to 7316004271253417984. Current Snapshot: MvccSnapshot[applied={T|T < 7316004271314288640}]
I20260807 20:17:35.311133 1104 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:35.311231 1104 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:35.311741 1104 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678: Sending DeleteTablet for 3 replicas of tablet 97bbfa3836f14cf8aee57caf253bbe32
I20260807 20:17:35.311993 1311 tablet_service.cc:1514] Processing DeleteTablet for tablet 97bbfa3836f14cf8aee57caf253bbe32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:35 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:34388
I20260807 20:17:35.312011 1729 tablet_service.cc:1514] Processing DeleteTablet for tablet 97bbfa3836f14cf8aee57caf253bbe32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:35 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:36832
I20260807 20:17:35.312095 2011 tablet_replica.cc:330] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91: stopping tablet replica
I20260807 20:17:35.312104 1529 tablet_service.cc:1514] Processing DeleteTablet for tablet 97bbfa3836f14cf8aee57caf253bbe32 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:35 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:51850
I20260807 20:17:35.312148 2011 raft_consensus.cc:2229] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:35.312196 2011 raft_consensus.cc:2258] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:35.312191 2012 tablet_replica.cc:330] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: stopping tablet replica
I20260807 20:17:35.312238 2012 raft_consensus.cc:2229] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:17:35.312290 2012 raft_consensus.cc:2258] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:35.312348 2014 tablet_replica.cc:330] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318: stopping tablet replica
I20260807 20:17:35.312397 2014 raft_consensus.cc:2229] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:35.312433 2014 raft_consensus.cc:2258] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:35.312481 2011 ts_tablet_manager.cc:1905] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:35.312739 2014 ts_tablet_manager.cc:1905] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:35.313829 2012 ts_tablet_manager.cc:1905] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:35.314028 2011 ts_tablet_manager.cc:1918] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 20:17:35.314096 2011 log.cc:1196] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-0/wal/wals/97bbfa3836f14cf8aee57caf253bbe32
I20260807 20:17:35.314162 2014 ts_tablet_manager.cc:1918] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 20:17:35.314215 2014 log.cc:1196] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/97bbfa3836f14cf8aee57caf253bbe32
I20260807 20:17:35.314306 2011 ts_tablet_manager.cc:1939] T 97bbfa3836f14cf8aee57caf253bbe32 P ad974baaca0e4e15846675a219f45b91: Deleting consensus metadata
I20260807 20:17:35.314401 2014 ts_tablet_manager.cc:1939] T 97bbfa3836f14cf8aee57caf253bbe32 P 134c56f4bf3c45c588afd7de05ea4318: Deleting consensus metadata
I20260807 20:17:35.314640 1083 catalog_manager.cc:4841] TS ad974baaca0e4e15846675a219f45b91 (127.30.35.193:33383): tablet 97bbfa3836f14cf8aee57caf253bbe32 (table test-table [id=bf5740d67e244ebf866ea2284ad4d94b]) successfully deleted
I20260807 20:17:35.314692 1084 catalog_manager.cc:4841] TS 134c56f4bf3c45c588afd7de05ea4318 (127.30.35.194:39453): tablet 97bbfa3836f14cf8aee57caf253bbe32 (table test-table [id=bf5740d67e244ebf866ea2284ad4d94b]) successfully deleted
I20260807 20:17:35.315183 2012 ts_tablet_manager.cc:1918] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 20:17:35.315237 2012 log.cc:1196] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/97bbfa3836f14cf8aee57caf253bbe32
I20260807 20:17:35.315371 2012 ts_tablet_manager.cc:1939] T 97bbfa3836f14cf8aee57caf253bbe32 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Deleting consensus metadata
I20260807 20:17:35.315749 1085 catalog_manager.cc:4841] TS 48cf55f0bfc54c0ab9e6d61d4e2054d2 (127.30.35.195:36241): tablet 97bbfa3836f14cf8aee57caf253bbe32 (table test-table [id=bf5740d67e244ebf866ea2284ad4d94b]) successfully deleted
I20260807 20:17:35.315737 1104 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44020:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:17:35.315900 1104 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:35.317039 1529 tablet_service.cc:1467] Processing CreateTablet for tablet 204eccf90196496f8200e1bbd822de78 (DEFAULT_TABLE table=test-table [id=0c335c7ffc5d4796b99a5d938d5a5cb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:35.317050 1311 tablet_service.cc:1467] Processing CreateTablet for tablet 204eccf90196496f8200e1bbd822de78 (DEFAULT_TABLE table=test-table [id=0c335c7ffc5d4796b99a5d938d5a5cb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:35.317147 1311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 204eccf90196496f8200e1bbd822de78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:35.317147 1529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 204eccf90196496f8200e1bbd822de78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:35.317740 1729 tablet_service.cc:1467] Processing CreateTablet for tablet 204eccf90196496f8200e1bbd822de78 (DEFAULT_TABLE table=test-table [id=0c335c7ffc5d4796b99a5d938d5a5cb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:35.317844 1729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 204eccf90196496f8200e1bbd822de78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:35.318282 2027 tablet_bootstrap.cc:492] T 204eccf90196496f8200e1bbd822de78 P ad974baaca0e4e15846675a219f45b91: Bootstrap starting.
I20260807 20:17:35.318288 2030 tablet_bootstrap.cc:492] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318: Bootstrap starting.
I20260807 20:17:35.318560 2030 tablet_bootstrap.cc:654] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:35.318598 2027 tablet_bootstrap.cc:654] T 204eccf90196496f8200e1bbd822de78 P ad974baaca0e4e15846675a219f45b91: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:35.318924 2023 tablet_bootstrap.cc:492] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Bootstrap starting.
I20260807 20:17:35.319012 2030 tablet_bootstrap.cc:492] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318: No bootstrap required, opened a new log
I20260807 20:17:35.319051 2030 ts_tablet_manager.cc:1397] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260807 20:17:35.319154 2030 raft_consensus.cc:348] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.319200 2030 raft_consensus.cc:374] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:35.319193 2023 tablet_bootstrap.cc:654] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:35.319212 2030 raft_consensus.cc:729] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 134c56f4bf3c45c588afd7de05ea4318, State: Initialized, Role: FOLLOWER
I20260807 20:17:35.319245 2030 consensus_queue.cc:260] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.319329 2030 ts_tablet_manager.cc:1428] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:35.319718 2027 tablet_bootstrap.cc:492] T 204eccf90196496f8200e1bbd822de78 P ad974baaca0e4e15846675a219f45b91: No bootstrap required, opened a new log
I20260807 20:17:35.319772 2027 ts_tablet_manager.cc:1397] T 204eccf90196496f8200e1bbd822de78 P ad974baaca0e4e15846675a219f45b91: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:35.319886 2027 raft_consensus.cc:348] T 204eccf90196496f8200e1bbd822de78 P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.319964 2027 raft_consensus.cc:374] T 204eccf90196496f8200e1bbd822de78 P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:35.319986 2027 raft_consensus.cc:729] T 204eccf90196496f8200e1bbd822de78 P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad974baaca0e4e15846675a219f45b91, State: Initialized, Role: FOLLOWER
I20260807 20:17:35.320027 2027 consensus_queue.cc:260] T 204eccf90196496f8200e1bbd822de78 P ad974baaca0e4e15846675a219f45b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.320113 2027 ts_tablet_manager.cc:1428] T 204eccf90196496f8200e1bbd822de78 P ad974baaca0e4e15846675a219f45b91: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:35.320338 2023 tablet_bootstrap.cc:492] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: No bootstrap required, opened a new log
I20260807 20:17:35.320389 2023 ts_tablet_manager.cc:1397] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260807 20:17:35.320498 2023 raft_consensus.cc:348] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.320564 2023 raft_consensus.cc:374] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:35.320585 2023 raft_consensus.cc:729] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48cf55f0bfc54c0ab9e6d61d4e2054d2, State: Initialized, Role: FOLLOWER
I20260807 20:17:35.320626 2023 consensus_queue.cc:260] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.320708 2023 ts_tablet_manager.cc:1428] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:35.585263 2045 raft_consensus.cc:482] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:35.585388 2045 raft_consensus.cc:504] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.585541 2045 leader_election.cc:288] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad974baaca0e4e15846675a219f45b91 (127.30.35.193:33383), 134c56f4bf3c45c588afd7de05ea4318 (127.30.35.194:39453)
I20260807 20:17:35.585795 1341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "204eccf90196496f8200e1bbd822de78" candidate_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad974baaca0e4e15846675a219f45b91" is_pre_election: true
I20260807 20:17:35.585803 1550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "204eccf90196496f8200e1bbd822de78" candidate_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "134c56f4bf3c45c588afd7de05ea4318" is_pre_election: true
I20260807 20:17:35.585891 1341 raft_consensus.cc:2454] T 204eccf90196496f8200e1bbd822de78 P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48cf55f0bfc54c0ab9e6d61d4e2054d2 in term 0.
I20260807 20:17:35.585918 1550 raft_consensus.cc:2454] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48cf55f0bfc54c0ab9e6d61d4e2054d2 in term 0.
I20260807 20:17:35.586056 1660 leader_election.cc:302] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48cf55f0bfc54c0ab9e6d61d4e2054d2, ad974baaca0e4e15846675a219f45b91; no voters:
I20260807 20:17:35.586153 2045 raft_consensus.cc:2781] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:35.586189 2045 raft_consensus.cc:482] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:35.586201 2045 raft_consensus.cc:3037] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:35.586865 2045 raft_consensus.cc:504] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.586983 2045 leader_election.cc:288] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [CANDIDATE]: Term 1 election: Requested vote from peers ad974baaca0e4e15846675a219f45b91 (127.30.35.193:33383), 134c56f4bf3c45c588afd7de05ea4318 (127.30.35.194:39453)
I20260807 20:17:35.587122 1550 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "204eccf90196496f8200e1bbd822de78" candidate_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "134c56f4bf3c45c588afd7de05ea4318"
I20260807 20:17:35.587132 1341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "204eccf90196496f8200e1bbd822de78" candidate_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad974baaca0e4e15846675a219f45b91"
I20260807 20:17:35.587190 1550 raft_consensus.cc:3037] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:35.587198 1341 raft_consensus.cc:3037] T 204eccf90196496f8200e1bbd822de78 P ad974baaca0e4e15846675a219f45b91 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:35.587746 1341 raft_consensus.cc:2454] T 204eccf90196496f8200e1bbd822de78 P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48cf55f0bfc54c0ab9e6d61d4e2054d2 in term 1.
I20260807 20:17:35.587815 1550 raft_consensus.cc:2454] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48cf55f0bfc54c0ab9e6d61d4e2054d2 in term 1.
I20260807 20:17:35.587960 1660 leader_election.cc:302] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48cf55f0bfc54c0ab9e6d61d4e2054d2, ad974baaca0e4e15846675a219f45b91; no voters:
I20260807 20:17:35.588064 2045 raft_consensus.cc:2781] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:35.588119 2045 raft_consensus.cc:686] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 LEADER]: Becoming Leader. State: Replica: 48cf55f0bfc54c0ab9e6d61d4e2054d2, State: Running, Role: LEADER
I20260807 20:17:35.588169 2045 consensus_queue.cc:237] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } }
I20260807 20:17:35.588755 1104 catalog_manager.cc:5495] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48cf55f0bfc54c0ab9e6d61d4e2054d2 (127.30.35.195). New cstate: current_term: 1 leader_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48cf55f0bfc54c0ab9e6d61d4e2054d2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 36241 } health_report { overall_health: HEALTHY } } }
I20260807 20:17:35.602041 1550 raft_consensus.cc:1261] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Refusing update from remote peer 48cf55f0bfc54c0ab9e6d61d4e2054d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:35.602057 1341 raft_consensus.cc:1261] T 204eccf90196496f8200e1bbd822de78 P ad974baaca0e4e15846675a219f45b91 [term 1 FOLLOWER]: Refusing update from remote peer 48cf55f0bfc54c0ab9e6d61d4e2054d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:35.602247 2045 consensus_queue.cc:1035] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "134c56f4bf3c45c588afd7de05ea4318" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 39453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:35.602375 2000 consensus_queue.cc:1035] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad974baaca0e4e15846675a219f45b91" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 20:17:35.605904 1988 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 20:17:37.121732 1104 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:37.121841 1104 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44020:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:37.122651 1104 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3fe618a9022a4e4cbe67ce735f346678: Sending DeleteTablet for 3 replicas of tablet 204eccf90196496f8200e1bbd822de78
I20260807 20:17:37.122879 1311 tablet_service.cc:1514] Processing DeleteTablet for tablet 204eccf90196496f8200e1bbd822de78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:37 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:34388
I20260807 20:17:37.122916 1529 tablet_service.cc:1514] Processing DeleteTablet for tablet 204eccf90196496f8200e1bbd822de78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:37 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:51850
I20260807 20:17:37.123024 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 1205
I20260807 20:17:37.123503 1729 tablet_service.cc:1514] Processing DeleteTablet for tablet 204eccf90196496f8200e1bbd822de78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:37 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:36832
I20260807 20:17:37.128121 2097 tablet_replica.cc:330] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: stopping tablet replica
I20260807 20:17:37.128206 2097 raft_consensus.cc:2229] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:17:37.128281 2097 raft_consensus.cc:2258] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:37.129208 2097 ts_tablet_manager.cc:1905] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:37.131291 2097 ts_tablet_manager.cc:1918] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 20:17:37.131357 2097 log.cc:1196] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/204eccf90196496f8200e1bbd822de78
I20260807 20:17:37.131644 2097 ts_tablet_manager.cc:1939] T 204eccf90196496f8200e1bbd822de78 P 48cf55f0bfc54c0ab9e6d61d4e2054d2: Deleting consensus metadata
I20260807 20:17:37.132002 1085 catalog_manager.cc:4841] TS 48cf55f0bfc54c0ab9e6d61d4e2054d2 (127.30.35.195:36241): tablet 204eccf90196496f8200e1bbd822de78 (table test-table [id=0c335c7ffc5d4796b99a5d938d5a5cb6]) successfully deleted
I20260807 20:17:37.140527 2096 tablet_replica.cc:330] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318: stopping tablet replica
I20260807 20:17:37.140622 2096 raft_consensus.cc:2229] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:37.140717 2096 raft_consensus.cc:2258] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:37.141021 2096 ts_tablet_manager.cc:1905] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:37.142550 2096 ts_tablet_manager.cc:1918] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 20:17:37.142609 2096 log.cc:1196] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/204eccf90196496f8200e1bbd822de78
I20260807 20:17:37.142798 2096 ts_tablet_manager.cc:1939] T 204eccf90196496f8200e1bbd822de78 P 134c56f4bf3c45c588afd7de05ea4318: Deleting consensus metadata
I20260807 20:17:37.143138 1084 catalog_manager.cc:4841] TS 134c56f4bf3c45c588afd7de05ea4318 (127.30.35.194:39453): tablet 204eccf90196496f8200e1bbd822de78 (table test-table [id=0c335c7ffc5d4796b99a5d938d5a5cb6]) successfully deleted
W20260807 20:17:37.146632 1083 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:33383 (error 108)
I20260807 20:17:37.146831 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 1425
I20260807 20:17:37.151762 2102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:37.151531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:33383 (local address 127.0.0.1:54354)
0807 20:17:37.151666 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:37.151724 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:33383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":72,"threads_started":1}
W20260807 20:17:37.151943 1083 catalog_manager.cc:4584] TS ad974baaca0e4e15846675a219f45b91 (127.30.35.193:33383): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 204eccf90196496f8200e1bbd822de78: Network error: Client connection negotiation failed: client connection to 127.30.35.193:33383: connect: Connection refused (error 111)
I20260807 20:17:37.155829 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 1638
I20260807 20:17:37.168292 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 1057
2026-08-07T20:17:37Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6207 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:17:37 dist-test-slave-t7g5 krb5kdc[2107](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:17:37 dist-test-slave-t7g5 krb5kdc[2107](info): set up 2 sockets
Aug 07 20:17:37 dist-test-slave-t7g5 krb5kdc[2107](info): commencing operation
krb5kdc: starting...
W20260807 20:17:38.311388 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:17:38 dist-test-slave-t7g5 krb5kdc[2107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:17:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:17:38.426173 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:34007
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:34007
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:38.506287 2127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:38.506527 2127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:38.506560 2127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:38.507745 2127 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:38.507789 2127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:38.507808 2127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:38.507825 2127 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:38.507840 2127 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:38.509341 2127 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:34007
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:34007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:38.509590 2127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:38.509840 2127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:38.514914 2134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:38.514896 2138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:38.514948 2127 server_base.cc:1034] running on GCE node
W20260807 20:17:38.514897 2136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:38.515383 2127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:38.515699 2127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:38.516880 2127 hybrid_clock.cc:648] HybridClock initialized: now 1786133858516858 us; error 34 us; skew 500 ppm
Aug 07 20:17:38 dist-test-slave-t7g5 krb5kdc[2107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133858, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:38.519408 2127 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:17:38.519840 2127 webserver.cc:460] Webserver started at http://127.30.35.254:34677/ using document root <none> and password file <none>
I20260807 20:17:38.520051 2127 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:38.520102 2127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:38.520238 2127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:38.521304 2127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "569c0ae68cb1465f9b3fdce2e2e66585"
format_stamp: "Formatted at 2026-08-07 20:17:38 on dist-test-slave-t7g5"
server_key: "937ecd7b7b8dec59d4148145d8901000"
server_key_iv: "1651f0810aa1cfd624b6c9aa005104dd"
server_key_version: "encryptionkey@0"
I20260807 20:17:38.521688 2127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "569c0ae68cb1465f9b3fdce2e2e66585"
format_stamp: "Formatted at 2026-08-07 20:17:38 on dist-test-slave-t7g5"
server_key: "937ecd7b7b8dec59d4148145d8901000"
server_key_iv: "1651f0810aa1cfd624b6c9aa005104dd"
server_key_version: "encryptionkey@0"
I20260807 20:17:38.522986 2127 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:17:38.523747 2149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:38.523906 2127 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:17:38.524005 2127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "569c0ae68cb1465f9b3fdce2e2e66585"
format_stamp: "Formatted at 2026-08-07 20:17:38 on dist-test-slave-t7g5"
server_key: "937ecd7b7b8dec59d4148145d8901000"
server_key_iv: "1651f0810aa1cfd624b6c9aa005104dd"
server_key_version: "encryptionkey@0"
I20260807 20:17:38.524066 2127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:38.538327 2127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:38.540079 2127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:38.540221 2127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:38.544054 2127 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:34007
I20260807 20:17:38.544086 2223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:34007 every 8 connection(s)
I20260807 20:17:38.544432 2127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:38.545310 2224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:38.547626 2224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585: Bootstrap starting.
I20260807 20:17:38.548192 2224 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:38.548467 2224 log.cc:824] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:38.549135 2224 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585: No bootstrap required, opened a new log
I20260807 20:17:38.550698 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 2127
I20260807 20:17:38.550777 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:38.550767 2224 raft_consensus.cc:348] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "569c0ae68cb1465f9b3fdce2e2e66585" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34007 } }
I20260807 20:17:38.550933 30863 external_mini_cluster.cc:1428] Setting key b954e75151a7c673fe3eab6ff2ba3a2a
I20260807 20:17:38.550943 2224 raft_consensus.cc:374] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:38.550974 2224 raft_consensus.cc:729] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 569c0ae68cb1465f9b3fdce2e2e66585, State: Initialized, Role: FOLLOWER
I20260807 20:17:38.551124 2224 consensus_queue.cc:260] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "569c0ae68cb1465f9b3fdce2e2e66585" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34007 } }
I20260807 20:17:38.551209 2224 raft_consensus.cc:388] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:38.551245 2224 raft_consensus.cc:482] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:38.551296 2224 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:38.552363 2224 raft_consensus.cc:504] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "569c0ae68cb1465f9b3fdce2e2e66585" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34007 } }
I20260807 20:17:38.552469 2224 leader_election.cc:302] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 569c0ae68cb1465f9b3fdce2e2e66585; no voters:
I20260807 20:17:38.552640 2224 leader_election.cc:288] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:38.552677 2230 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:38.552834 2230 raft_consensus.cc:686] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [term 1 LEADER]: Becoming Leader. State: Replica: 569c0ae68cb1465f9b3fdce2e2e66585, State: Running, Role: LEADER
I20260807 20:17:38.552901 2224 sys_catalog.cc:564] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:38.552937 2230 consensus_queue.cc:237] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "569c0ae68cb1465f9b3fdce2e2e66585" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34007 } }
I20260807 20:17:38.553296 2230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 569c0ae68cb1465f9b3fdce2e2e66585. Latest consensus state: current_term: 1 leader_uuid: "569c0ae68cb1465f9b3fdce2e2e66585" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "569c0ae68cb1465f9b3fdce2e2e66585" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34007 } } }
I20260807 20:17:38.553387 2231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "569c0ae68cb1465f9b3fdce2e2e66585" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "569c0ae68cb1465f9b3fdce2e2e66585" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34007 } } }
I20260807 20:17:38.553434 2230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:38.553544 2231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:38.553791 2238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:38.554538 2238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:38.556228 2238 catalog_manager.cc:1347] Generated new cluster ID: 73f0f86725104528bbd5a6bb96bf4eca
I20260807 20:17:38.556284 2238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:17:38 dist-test-slave-t7g5 krb5kdc[2107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:38.563804 2229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:38.551415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40400 (local address 127.30.35.254:34007)
0807 20:17:38.551599 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:38.551609 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:38.551665 (+ 56us) server_negotiation.cc:407] Connection header received
0807 20:17:38.551793 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:38.551802 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:38.551862 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:38.552013 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:38.552612 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:38.554017 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:38.555072 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:38.555562 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:38.555664 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:38.558466 (+ 2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:38.558470 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:38.558471 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:38.558483 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:38.560984 (+ 2501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:38.561386 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:38.561389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:38.561389 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:38.561500 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:38.561734 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:38.561736 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:38.561736 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:38.562077 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:38.563342 (+ 1265us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:38.563422 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 20:17:38.563570 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":96,"threads_started":1}
I20260807 20:17:38.569365 2238 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:38.570096 2238 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:38.576093 2238 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 569c0ae68cb1465f9b3fdce2e2e66585: Generated new TSK 0
I20260807 20:17:38.576278 2238 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:17:38.604058 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34007
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:38.686239 2261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:38.686456 2261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:38.686477 2261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:38.687556 2261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:38.687587 2261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:38.687610 2261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:17:38.688977 2261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:38.689157 2261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:38.689332 2261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:38.693912 2274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:38.693938 2271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:38.693960 2272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:38.694188 2261 server_base.cc:1034] running on GCE node
I20260807 20:17:38.694356 2261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:38.694552 2261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:38.695681 2261 hybrid_clock.cc:648] HybridClock initialized: now 1786133858695667 us; error 30 us; skew 500 ppm
Aug 07 20:17:38 dist-test-slave-t7g5 krb5kdc[2107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133858, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:38.698094 2261 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:17:38.698529 2261 webserver.cc:460] Webserver started at http://127.30.35.193:35973/ using document root <none> and password file <none>
I20260807 20:17:38.698724 2261 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:38.698768 2261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:38.698900 2261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:38.699918 2261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "6bc7e337f24d400cb6b49b3c6d0f30b9"
format_stamp: "Formatted at 2026-08-07 20:17:38 on dist-test-slave-t7g5"
server_key: "8538c837ab50c3411b5d3c2d870c8ac3"
server_key_iv: "4e6b43e070680442289955ea243af21a"
server_key_version: "encryptionkey@0"
I20260807 20:17:38.700261 2261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "6bc7e337f24d400cb6b49b3c6d0f30b9"
format_stamp: "Formatted at 2026-08-07 20:17:38 on dist-test-slave-t7g5"
server_key: "8538c837ab50c3411b5d3c2d870c8ac3"
server_key_iv: "4e6b43e070680442289955ea243af21a"
server_key_version: "encryptionkey@0"
I20260807 20:17:38.701472 2261 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:38.702189 2286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:38.702333 2261 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:38.702425 2261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "6bc7e337f24d400cb6b49b3c6d0f30b9"
format_stamp: "Formatted at 2026-08-07 20:17:38 on dist-test-slave-t7g5"
server_key: "8538c837ab50c3411b5d3c2d870c8ac3"
server_key_iv: "4e6b43e070680442289955ea243af21a"
server_key_version: "encryptionkey@0"
I20260807 20:17:38.702489 2261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:38.726562 2261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:38.728609 2261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:38.728749 2261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:38.728971 2261 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:38.729285 2261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:38.729323 2261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:38.729354 2261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:38.729388 2261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:38.734861 2261 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:39707
I20260807 20:17:38.734923 2464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:39707 every 8 connection(s)
I20260807 20:17:38.735211 2261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:17:38.739493 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 2261
I20260807 20:17:38.739590 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:17:38.739771 30863 external_mini_cluster.cc:1428] Setting key af12e21d817ae96b31771607ad26a0e9
Aug 07 20:17:38 dist-test-slave-t7g5 krb5kdc[2107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133858, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:38.744328 2229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:38.735893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:40851 (local address 127.30.35.254:34007)
0807 20:17:38.735954 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:38.735956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:38.736149 (+ 193us) server_negotiation.cc:407] Connection header received
0807 20:17:38.736623 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:38.736625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:38.736635 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:38.736683 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:38.737574 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:38.738101 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:38.739017 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:38.739215 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:38.739261 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:38.741577 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:38.741579 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:38.741579 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:38.741589 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:38.743068 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:38.743453 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:38.743454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:38.743455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:38.743516 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:38.743726 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:38.743726 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:38.743727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:38.743862 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:38.743926 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:38.744152 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 20:17:38.744239 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 20:17:38.744415 2470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:38.735897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34007 (local address 127.30.35.193:40851)
0807 20:17:38.736038 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:38.736076 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:38.736543 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:38.736738 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:38.736742 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:38.737299 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:38.737504 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:38.737509 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:38.738168 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:38.738169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:38.738953 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:38.738956 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:38.739269 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:38.739269 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:38.739410 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:38.739956 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:38.739964 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:38.741484 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:38.743149 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:38.743156 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:38.743158 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:38.743383 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:38.743586 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:38.743587 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:38.743587 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:38.743677 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:38.743917 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:38.743922 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:38.744034 (+ 112us) client_negotiation.cc:769] Sending connection context
0807 20:17:38.744115 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 20:17:38.744237 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":77,"threads_started":1}
I20260807 20:17:38.744995 2467 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34007
I20260807 20:17:38.745082 2467 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:38.745252 2467 heartbeater.cc:511] Master 127.30.35.254:34007 requested a full tablet report, sending...
I20260807 20:17:38.745843 2170 ts_manager.cc:194] Registered new tserver with Master: 6bc7e337f24d400cb6b49b3c6d0f30b9 (127.30.35.193:39707)
I20260807 20:17:38.746706 2170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:40851
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:17:38.764350 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34007
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:38.847697 2473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:38.847922 2473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:38.847947 2473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:38.849041 2473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:38.849082 2473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:38.849108 2473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:17:38.850565 2473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:38.850771 2473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:38.850957 2473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:38.856143 2489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:38.856195 2473 server_base.cc:1034] running on GCE node
W20260807 20:17:38.856169 2485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:38.856168 2482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:38.856537 2473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:38.856772 2473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:38.857910 2473 hybrid_clock.cc:648] HybridClock initialized: now 1786133858857893 us; error 35 us; skew 500 ppm
Aug 07 20:17:38 dist-test-slave-t7g5 krb5kdc[2107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133858, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:38.860338 2473 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:17:38.860761 2473 webserver.cc:460] Webserver started at http://127.30.35.194:36279/ using document root <none> and password file <none>
I20260807 20:17:38.860981 2473 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:38.861037 2473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:38.861162 2473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:38.862241 2473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "d06be4523f5946de80d302b9510a3561"
format_stamp: "Formatted at 2026-08-07 20:17:38 on dist-test-slave-t7g5"
server_key: "243b806bbc7f192b6a4610847f1ebece"
server_key_iv: "678993e03697ba8b3eed86cb68e7da28"
server_key_version: "encryptionkey@0"
I20260807 20:17:38.862589 2473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "d06be4523f5946de80d302b9510a3561"
format_stamp: "Formatted at 2026-08-07 20:17:38 on dist-test-slave-t7g5"
server_key: "243b806bbc7f192b6a4610847f1ebece"
server_key_iv: "678993e03697ba8b3eed86cb68e7da28"
server_key_version: "encryptionkey@0"
I20260807 20:17:38.863806 2473 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:38.864462 2497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:38.864614 2473 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:38.864697 2473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "d06be4523f5946de80d302b9510a3561"
format_stamp: "Formatted at 2026-08-07 20:17:38 on dist-test-slave-t7g5"
server_key: "243b806bbc7f192b6a4610847f1ebece"
server_key_iv: "678993e03697ba8b3eed86cb68e7da28"
server_key_version: "encryptionkey@0"
I20260807 20:17:38.864755 2473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:38.874531 2473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:38.876319 2473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:38.876467 2473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:38.876680 2473 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:38.877012 2473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:38.877048 2473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:38.877079 2473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:38.877102 2473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:38.882977 2473 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:40829
I20260807 20:17:38.883018 2681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:40829 every 8 connection(s)
I20260807 20:17:38.883387 2473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
Aug 07 20:17:38 dist-test-slave-t7g5 krb5kdc[2107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133858, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:38.889460 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 2473
I20260807 20:17:38.889546 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:17:38.889776 30863 external_mini_cluster.cc:1428] Setting key 0e11aa4196553301406c3aae553494e4
I20260807 20:17:38.892457 2229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:38.884127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:57107 (local address 127.30.35.254:34007)
0807 20:17:38.884190 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:38.884192 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:38.884440 (+ 248us) server_negotiation.cc:407] Connection header received
0807 20:17:38.884882 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:38.884884 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:38.884895 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:38.884952 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:38.885927 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:38.886411 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:38.887405 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:38.887591 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:38.887636 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:38.889747 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:38.889750 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:38.889751 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:38.889759 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:38.891153 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:38.891538 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:38.891539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:38.891539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:38.891603 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:38.891823 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:38.891825 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:38.891825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:38.891943 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:38.892001 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:38.892268 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 20:17:38.892354 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 20:17:38.892625 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:38.884102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34007 (local address 127.30.35.194:57107)
0807 20:17:38.884264 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:38.884321 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:38.884793 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:38.885014 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:38.885018 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:38.885584 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:38.885851 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:38.885858 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:38.886497 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:38.886498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:38.887342 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:38.887344 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:38.887656 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:38.887657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:38.887763 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:38.888219 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:38.888227 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:38.889586 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:38.891228 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:38.891236 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:38.891238 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:38.891468 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:38.891656 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:38.891657 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:38.891657 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:38.891766 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:38.891999 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:38.892006 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:38.892148 (+ 142us) client_negotiation.cc:769] Sending connection context
0807 20:17:38.892238 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 20:17:38.892401 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
I20260807 20:17:38.893213 2682 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34007
I20260807 20:17:38.893311 2682 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:38.893501 2682 heartbeater.cc:511] Master 127.30.35.254:34007 requested a full tablet report, sending...
I20260807 20:17:38.893895 2170 ts_manager.cc:194] Registered new tserver with Master: d06be4523f5946de80d302b9510a3561 (127.30.35.194:40829)
I20260807 20:17:38.894266 2170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:57107
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:17:38.914532 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34007
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:38.996419 2694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:38.996635 2694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:38.996657 2694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:38.997838 2694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:38.997880 2694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:38.997908 2694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:17:38.999365 2694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34007
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:38.999584 2694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:38.999799 2694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:39.004583 2699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:39.004720 2694 server_base.cc:1034] running on GCE node
W20260807 20:17:39.004616 2700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:39.004583 2702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:39.005008 2694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:39.005306 2694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:39.006451 2694 hybrid_clock.cc:648] HybridClock initialized: now 1786133859006434 us; error 33 us; skew 500 ppm
Aug 07 20:17:39 dist-test-slave-t7g5 krb5kdc[2107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133859, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:39.008844 2694 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:17:39.009285 2694 webserver.cc:460] Webserver started at http://127.30.35.195:46303/ using document root <none> and password file <none>
I20260807 20:17:39.009500 2694 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:39.009550 2694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:39.009711 2694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:39.010773 2694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "f3508e290db548069877b7e22888ec2a"
format_stamp: "Formatted at 2026-08-07 20:17:39 on dist-test-slave-t7g5"
server_key: "e78de0ebf3d187d67faca87b3e5be190"
server_key_iv: "b7e6365b3522600b0db638605103c49a"
server_key_version: "encryptionkey@0"
I20260807 20:17:39.011117 2694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "f3508e290db548069877b7e22888ec2a"
format_stamp: "Formatted at 2026-08-07 20:17:39 on dist-test-slave-t7g5"
server_key: "e78de0ebf3d187d67faca87b3e5be190"
server_key_iv: "b7e6365b3522600b0db638605103c49a"
server_key_version: "encryptionkey@0"
I20260807 20:17:39.012369 2694 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:39.013020 2711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:39.013178 2694 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:39.013266 2694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "f3508e290db548069877b7e22888ec2a"
format_stamp: "Formatted at 2026-08-07 20:17:39 on dist-test-slave-t7g5"
server_key: "e78de0ebf3d187d67faca87b3e5be190"
server_key_iv: "b7e6365b3522600b0db638605103c49a"
server_key_version: "encryptionkey@0"
I20260807 20:17:39.013332 2694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:39.024259 2694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:39.026177 2694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:39.026312 2694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:39.026552 2694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:39.026885 2694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:39.026921 2694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:39.026949 2694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:39.026968 2694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:39.032369 2694 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:36763
I20260807 20:17:39.032439 2898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:36763 every 8 connection(s)
I20260807 20:17:39.032735 2694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
Aug 07 20:17:39 dist-test-slave-t7g5 krb5kdc[2107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133859, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:39.039968 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 2694
I20260807 20:17:39.040062 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:17:39.040238 30863 external_mini_cluster.cc:1428] Setting key cda7cac1d9fbadfc558682511471cbba
I20260807 20:17:39.041711 2229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:39.033423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:55803 (local address 127.30.35.254:34007)
0807 20:17:39.033485 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:39.033487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:39.033673 (+ 186us) server_negotiation.cc:407] Connection header received
0807 20:17:39.034209 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:39.034211 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:39.034224 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:39.034275 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:39.035254 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:39.035752 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:39.036727 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:39.036920 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:39.036976 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:39.039041 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:39.039043 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:39.039044 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:39.039051 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:39.040402 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:39.040763 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:39.040765 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:39.040766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:39.040827 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:39.041052 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:39.041053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:39.041054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:39.041176 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:39.041232 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:39.041501 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 20:17:39.041595 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 20:17:39.041872 2902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:39.033384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34007 (local address 127.30.35.195:55803)
0807 20:17:39.033557 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:39.033593 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:39.034106 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:39.034359 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:39.034371 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:39.034952 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:39.035152 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:39.035158 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:39.035836 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:39.035838 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:39.036639 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:39.036641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:39.036988 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:39.036989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:39.037116 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:39.037596 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:39.037605 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:39.038946 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:39.040469 (+ 1523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:39.040477 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:39.040479 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:39.040697 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:39.040882 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:39.040883 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:39.040883 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:39.040993 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:39.041228 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:39.041234 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:39.041379 (+ 145us) client_negotiation.cc:769] Sending connection context
0807 20:17:39.041469 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 20:17:39.041629 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":91,"threads_started":1}
I20260807 20:17:39.042284 2900 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34007
I20260807 20:17:39.042383 2900 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:39.042568 2900 heartbeater.cc:511] Master 127.30.35.254:34007 requested a full tablet report, sending...
I20260807 20:17:39.042896 2170 ts_manager.cc:194] Registered new tserver with Master: f3508e290db548069877b7e22888ec2a (127.30.35.195:36763)
I20260807 20:17:39.043251 2170 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:55803
I20260807 20:17:39.051813 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 20:17:39.064774 2229 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:17:39.063959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40404 (local address 127.30.35.254:34007)
0807 20:17:39.064015 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:39.064016 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:39.064104 (+ 88us) server_negotiation.cc:407] Connection header received
0807 20:17:39.064159 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:39.064159 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:39.064168 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:39.064222 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:39.064713 (+ 491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40404: BlockingRecv error: recv got EOF from 127.0.0.1:40404 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 20:17:39.065729 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 2261
I20260807 20:17:39.082180 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 2473
I20260807 20:17:39.088909 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 2694
I20260807 20:17:39.097118 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 2127
2026-08-07T20:17:39Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1926 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:17:39 dist-test-slave-t7g5 krb5kdc[2920](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:17:39 dist-test-slave-t7g5 krb5kdc[2920](info): set up 2 sockets
Aug 07 20:17:39 dist-test-slave-t7g5 krb5kdc[2920](info): commencing operation
krb5kdc: starting...
W20260807 20:17:40.245688 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:17:40 dist-test-slave-t7g5 krb5kdc[2920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:17:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:17:40.360113 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:37253
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:37253
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:40.441102 2936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:40.441325 2936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:40.441356 2936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:40.442585 2936 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:40.442634 2936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:40.442652 2936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:40.442668 2936 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:40.442682 2936 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:40.444201 2936 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:37253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:37253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:40.444458 2936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:40.444664 2936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:40.449389 2943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:40.449457 2944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:40.449432 2947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:40.449604 2936 server_base.cc:1034] running on GCE node
I20260807 20:17:40.449898 2936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:40.450165 2936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:40.451303 2936 hybrid_clock.cc:648] HybridClock initialized: now 1786133860451291 us; error 30 us; skew 500 ppm
Aug 07 20:17:40 dist-test-slave-t7g5 krb5kdc[2920](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133860, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:40.457165 2936 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:17:40.457593 2936 webserver.cc:460] Webserver started at http://127.30.35.254:44501/ using document root <none> and password file <none>
I20260807 20:17:40.457808 2936 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:40.457858 2936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:40.457985 2936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:40.459041 2936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "993cd4e736c94426b6752bd7dbfbe42f"
format_stamp: "Formatted at 2026-08-07 20:17:40 on dist-test-slave-t7g5"
server_key: "54fb08b500eecf98e7e3ca1f405988a7"
server_key_iv: "a78dca7c896091113df6b762d9d2406f"
server_key_version: "encryptionkey@0"
I20260807 20:17:40.459369 2936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "993cd4e736c94426b6752bd7dbfbe42f"
format_stamp: "Formatted at 2026-08-07 20:17:40 on dist-test-slave-t7g5"
server_key: "54fb08b500eecf98e7e3ca1f405988a7"
server_key_iv: "a78dca7c896091113df6b762d9d2406f"
server_key_version: "encryptionkey@0"
I20260807 20:17:40.460598 2936 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:17:40.461229 2955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:40.461382 2936 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:40.461472 2936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "993cd4e736c94426b6752bd7dbfbe42f"
format_stamp: "Formatted at 2026-08-07 20:17:40 on dist-test-slave-t7g5"
server_key: "54fb08b500eecf98e7e3ca1f405988a7"
server_key_iv: "a78dca7c896091113df6b762d9d2406f"
server_key_version: "encryptionkey@0"
I20260807 20:17:40.461534 2936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:40.482743 2936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:40.484678 2936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:40.484790 2936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:40.488564 2936 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:37253
I20260807 20:17:40.488608 3044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:37253 every 8 connection(s)
I20260807 20:17:40.489073 2936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:40.489743 3045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:40.492072 3045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f: Bootstrap starting.
I20260807 20:17:40.492650 3045 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:40.492970 3045 log.cc:824] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:40.493618 3045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f: No bootstrap required, opened a new log
I20260807 20:17:40.495189 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 2936
I20260807 20:17:40.495258 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:40.495215 3045 raft_consensus.cc:348] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "993cd4e736c94426b6752bd7dbfbe42f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37253 } }
I20260807 20:17:40.495381 3045 raft_consensus.cc:374] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:40.495411 30863 external_mini_cluster.cc:1428] Setting key 7ed1229f2ac4e5b2cdc9e0356a73a28d
I20260807 20:17:40.495425 3045 raft_consensus.cc:729] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 993cd4e736c94426b6752bd7dbfbe42f, State: Initialized, Role: FOLLOWER
I20260807 20:17:40.495571 3045 consensus_queue.cc:260] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "993cd4e736c94426b6752bd7dbfbe42f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37253 } }
I20260807 20:17:40.495653 3045 raft_consensus.cc:388] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:40.495687 3045 raft_consensus.cc:482] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:40.495733 3045 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:40.496344 3045 raft_consensus.cc:504] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "993cd4e736c94426b6752bd7dbfbe42f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37253 } }
I20260807 20:17:40.496448 3045 leader_election.cc:302] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 993cd4e736c94426b6752bd7dbfbe42f; no voters:
I20260807 20:17:40.496608 3045 leader_election.cc:288] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:40.496649 3060 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:40.496789 3060 raft_consensus.cc:686] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [term 1 LEADER]: Becoming Leader. State: Replica: 993cd4e736c94426b6752bd7dbfbe42f, State: Running, Role: LEADER
I20260807 20:17:40.496857 3045 sys_catalog.cc:564] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:40.496884 3060 consensus_queue.cc:237] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "993cd4e736c94426b6752bd7dbfbe42f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37253 } }
I20260807 20:17:40.497255 3060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 993cd4e736c94426b6752bd7dbfbe42f. Latest consensus state: current_term: 1 leader_uuid: "993cd4e736c94426b6752bd7dbfbe42f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "993cd4e736c94426b6752bd7dbfbe42f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37253 } } }
I20260807 20:17:40.497325 3060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:40.497301 3061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "993cd4e736c94426b6752bd7dbfbe42f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "993cd4e736c94426b6752bd7dbfbe42f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37253 } } }
I20260807 20:17:40.497397 3061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:40.497586 3071 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:40.498375 3071 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:40.500012 3071 catalog_manager.cc:1347] Generated new cluster ID: 2c0d3dae6c65404badd0030bc710468c
I20260807 20:17:40.500067 3071 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:17:40 dist-test-slave-t7g5 krb5kdc[2920](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:40.508265 3057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:40.495869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36804 (local address 127.30.35.254:37253)
0807 20:17:40.496408 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:40.496416 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:40.496443 (+ 27us) server_negotiation.cc:407] Connection header received
0807 20:17:40.496563 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:40.496570 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:40.496625 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:40.496776 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:40.497741 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:40.499224 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:40.500218 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:40.500845 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:40.500970 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:40.503702 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:40.503707 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:40.503707 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:40.503723 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:40.506568 (+ 2845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:40.506951 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:40.506955 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:40.506955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:40.507093 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:40.507268 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:40.507269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:40.507269 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:40.507638 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:40.507813 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:40.507882 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 20:17:40.508030 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":441,"threads_started":1}
I20260807 20:17:40.509495 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:17:40.526898 3057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:40.522694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36806 (local address 127.30.35.254:37253)
0807 20:17:40.522744 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:40.522746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:40.522960 (+ 214us) server_negotiation.cc:407] Connection header received
0807 20:17:40.523036 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:40.523037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:40.523050 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:40.523103 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:40.523538 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:40.524254 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:40.525276 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:40.525587 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:40.525640 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:40.526394 (+ 754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:40.526396 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:40.526397 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:40.526648 (+ 251us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:40.526668 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:40.526675 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:40.526726 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:40.526788 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 20:17:40.526813 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 20:17:40.530725 3071 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:40.531476 3071 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:40.537228 3071 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 993cd4e736c94426b6752bd7dbfbe42f: Generated new TSK 0
I20260807 20:17:40.537453 3071 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:17:40.542263 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 2936
2026-08-07T20:17:40Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1450 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:17:40 dist-test-slave-t7g5 krb5kdc[3106](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:17:40 dist-test-slave-t7g5 krb5kdc[3106](info): set up 2 sockets
Aug 07 20:17:40 dist-test-slave-t7g5 krb5kdc[3106](info): commencing operation
krb5kdc: starting...
W20260807 20:17:41.695928 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:17:41 dist-test-slave-t7g5 krb5kdc[3106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:17:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:17:41.812197 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:36649
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:40537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:36649
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:41.897838 3122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:41.898075 3122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:41.898101 3122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:41.899262 3122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:41.899304 3122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:41.899320 3122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:41.899333 3122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:41.899353 3122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:41.900830 3122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:36649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:36649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3122
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:41.901057 3122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:41.901271 3122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:41.906138 3132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:41.906169 3135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:41.906203 3122 server_base.cc:1034] running on GCE node
W20260807 20:17:41.906147 3142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:41.906594 3122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:41.906852 3122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:41.908020 3122 hybrid_clock.cc:648] HybridClock initialized: now 1786133861907999 us; error 38 us; skew 500 ppm
Aug 07 20:17:41 dist-test-slave-t7g5 krb5kdc[3106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133861, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:41.910485 3122 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:17:41.910904 3122 webserver.cc:460] Webserver started at http://127.30.35.254:39551/ using document root <none> and password file <none>
I20260807 20:17:41.911123 3122 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:41.911168 3122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:41.911296 3122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:41.912359 3122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "5dfb0a93ecc8477d9084095026ddf98e"
format_stamp: "Formatted at 2026-08-07 20:17:41 on dist-test-slave-t7g5"
server_key: "4f1f7691308306d0010caa739e33c51b"
server_key_iv: "fa9d0b2ea5edd49dba94eeb778a59ff6"
server_key_version: "encryptionkey@0"
I20260807 20:17:41.912694 3122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "5dfb0a93ecc8477d9084095026ddf98e"
format_stamp: "Formatted at 2026-08-07 20:17:41 on dist-test-slave-t7g5"
server_key: "4f1f7691308306d0010caa739e33c51b"
server_key_iv: "fa9d0b2ea5edd49dba94eeb778a59ff6"
server_key_version: "encryptionkey@0"
I20260807 20:17:41.914016 3122 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 20:17:41.914685 3156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:41.914817 3122 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:41.914903 3122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "5dfb0a93ecc8477d9084095026ddf98e"
format_stamp: "Formatted at 2026-08-07 20:17:41 on dist-test-slave-t7g5"
server_key: "4f1f7691308306d0010caa739e33c51b"
server_key_iv: "fa9d0b2ea5edd49dba94eeb778a59ff6"
server_key_version: "encryptionkey@0"
I20260807 20:17:41.914971 3122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:41.942135 3122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:41.944100 3122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:41.944249 3122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:41.948050 3122 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:36649
I20260807 20:17:41.948102 3230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:36649 every 8 connection(s)
I20260807 20:17:41.948431 3122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:41.949414 3231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:41.951763 3231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e: Bootstrap starting.
I20260807 20:17:41.952327 3231 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:41.952595 3231 log.cc:824] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:41.953262 3231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e: No bootstrap required, opened a new log
I20260807 20:17:41.954854 3231 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5dfb0a93ecc8477d9084095026ddf98e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36649 } }
I20260807 20:17:41.955020 3231 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:41.955056 3231 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dfb0a93ecc8477d9084095026ddf98e, State: Initialized, Role: FOLLOWER
I20260807 20:17:41.955201 3231 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5dfb0a93ecc8477d9084095026ddf98e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36649 } }
I20260807 20:17:41.955278 3231 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:41.955314 3231 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:41.955363 3231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:41.956151 3231 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5dfb0a93ecc8477d9084095026ddf98e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36649 } }
I20260807 20:17:41.956247 3231 leader_election.cc:302] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5dfb0a93ecc8477d9084095026ddf98e; no voters:
I20260807 20:17:41.956413 3231 leader_election.cc:288] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:41.956453 3235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:41.956609 3235 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [term 1 LEADER]: Becoming Leader. State: Replica: 5dfb0a93ecc8477d9084095026ddf98e, State: Running, Role: LEADER
I20260807 20:17:41.956647 3231 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:41.956702 3235 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5dfb0a93ecc8477d9084095026ddf98e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36649 } }
I20260807 20:17:41.957082 3236 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5dfb0a93ecc8477d9084095026ddf98e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5dfb0a93ecc8477d9084095026ddf98e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36649 } } }
I20260807 20:17:41.957099 3237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5dfb0a93ecc8477d9084095026ddf98e. Latest consensus state: current_term: 1 leader_uuid: "5dfb0a93ecc8477d9084095026ddf98e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5dfb0a93ecc8477d9084095026ddf98e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36649 } } }
I20260807 20:17:41.957240 3237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:41.957444 3236 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:41.957469 3247 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:41.957852 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 3122
I20260807 20:17:41.957957 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:41.958047 3247 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:41.958133 30863 external_mini_cluster.cc:1428] Setting key 65355cbb1aa92cfa2b268059b419ef31
I20260807 20:17:41.959690 3247 catalog_manager.cc:1347] Generated new cluster ID: ad40b66f16304f74992a4500b2779c75
I20260807 20:17:41.959744 3247 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:17:41 dist-test-slave-t7g5 krb5kdc[3106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:41.967227 3266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:41.958633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48198 (local address 127.30.35.254:36649)
0807 20:17:41.958908 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:41.958917 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:41.958948 (+ 31us) server_negotiation.cc:407] Connection header received
0807 20:17:41.959059 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:41.959066 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:41.959138 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:41.959269 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:41.959932 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:41.960832 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:41.961562 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:41.962068 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:41.962174 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:41.964295 (+ 2121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:41.964299 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:41.964299 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:41.964311 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:41.965812 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:41.966127 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:41.966130 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:41.966131 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:41.966233 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:41.966410 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:41.966410 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:41.966411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:41.966643 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:41.966784 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:41.966905 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 20:17:41.967043 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":84,"threads_started":1}
I20260807 20:17:41.984512 3247 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:41.985236 3247 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:41.991490 3247 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5dfb0a93ecc8477d9084095026ddf98e: Generated new TSK 0
I20260807 20:17:41.991677 3247 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:17:42.020507 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36649
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:40537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:42.102389 3275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:42.102594 3275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:42.102618 3275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:42.103734 3275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:42.103778 3275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:42.103804 3275 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:17:42.105281 3275 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:42.105512 3275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:42.105749 3275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:42.110512 3284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:42.110682 3275 server_base.cc:1034] running on GCE node
W20260807 20:17:42.110505 3287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:42.110517 3290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:42.110966 3275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:42.111191 3275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:42.112334 3275 hybrid_clock.cc:648] HybridClock initialized: now 1786133862112319 us; error 32 us; skew 500 ppm
Aug 07 20:17:42 dist-test-slave-t7g5 krb5kdc[3106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133862, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:42.114876 3275 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:17:42.115293 3275 webserver.cc:460] Webserver started at http://127.30.35.193:46643/ using document root <none> and password file <none>
I20260807 20:17:42.115525 3275 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:42.115574 3275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:42.115700 3275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:42.116705 3275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "36f5f0799a464c6e8005f6f11a8eb877"
format_stamp: "Formatted at 2026-08-07 20:17:42 on dist-test-slave-t7g5"
server_key: "e60c92dd548956823bb67d32365d3653"
server_key_iv: "e2724317903347bf00eac7baa6f8df41"
server_key_version: "encryptionkey@0"
I20260807 20:17:42.117044 3275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "36f5f0799a464c6e8005f6f11a8eb877"
format_stamp: "Formatted at 2026-08-07 20:17:42 on dist-test-slave-t7g5"
server_key: "e60c92dd548956823bb67d32365d3653"
server_key_iv: "e2724317903347bf00eac7baa6f8df41"
server_key_version: "encryptionkey@0"
I20260807 20:17:42.118405 3275 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:17:42.119113 3302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:42.119261 3275 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:42.119354 3275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "36f5f0799a464c6e8005f6f11a8eb877"
format_stamp: "Formatted at 2026-08-07 20:17:42 on dist-test-slave-t7g5"
server_key: "e60c92dd548956823bb67d32365d3653"
server_key_iv: "e2724317903347bf00eac7baa6f8df41"
server_key_version: "encryptionkey@0"
I20260807 20:17:42.119421 3275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:42.127461 3275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:42.129014 3275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:42.129141 3275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:42.129331 3275 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:42.129602 3275 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:42.129634 3275 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:42.129683 3275 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:42.129711 3275 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:42.136761 3275 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:44621
I20260807 20:17:42.136821 3479 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:44621 every 8 connection(s)
I20260807 20:17:42.137102 3275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
Aug 07 20:17:42 dist-test-slave-t7g5 krb5kdc[3106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133862, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:42.145852 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 3275
I20260807 20:17:42.145954 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:17:42.145963 3266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:42.137820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:55405 (local address 127.30.35.254:36649)
0807 20:17:42.137866 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:42.137868 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:42.138064 (+ 196us) server_negotiation.cc:407] Connection header received
0807 20:17:42.138562 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:42.138563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:42.138578 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:42.138630 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:42.139581 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:42.140090 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:42.141093 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:42.141307 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:42.141364 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:42.143440 (+ 2076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:42.143441 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:42.143442 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:42.143450 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:42.144590 (+ 1140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:42.144997 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:42.144998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:42.144998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:42.145057 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:42.145279 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:42.145280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:42.145281 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:42.145395 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:42.145452 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:42.145763 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 20:17:42.145871 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:17:42.146123 3483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:42.137810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:36649 (local address 127.30.35.193:55405)
0807 20:17:42.137948 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:42.137984 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:42.138460 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:42.138703 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:42.138707 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:42.139281 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:42.139474 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:42.139479 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:42.140176 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:42.140177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:42.141000 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:42.141003 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:42.141379 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:42.141380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:42.141516 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:42.141977 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:42.141985 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:42.143334 (+ 1349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:42.144665 (+ 1331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:42.144672 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:42.144674 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:42.144922 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:42.145111 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:42.145112 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:42.145112 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:42.145214 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:42.145451 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:42.145459 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:42.145589 (+ 130us) client_negotiation.cc:769] Sending connection context
0807 20:17:42.145736 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 20:17:42.145904 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":63,"threads_started":1}
I20260807 20:17:42.146144 30863 external_mini_cluster.cc:1428] Setting key cc26b8f77ea37ca8119c57181c771c79
I20260807 20:17:42.146631 3481 heartbeater.cc:347] Connected to a master server at 127.30.35.254:36649
I20260807 20:17:42.146721 3481 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:42.146908 3481 heartbeater.cc:511] Master 127.30.35.254:36649 requested a full tablet report, sending...
I20260807 20:17:42.147450 3180 ts_manager.cc:194] Registered new tserver with Master: 36f5f0799a464c6e8005f6f11a8eb877 (127.30.35.193:44621)
I20260807 20:17:42.148025 3180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:55405
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:17:42.170503 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36649
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:40537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:42.253432 3486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:42.253643 3486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:42.253690 3486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:42.254876 3486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:42.254928 3486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:42.254953 3486 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:17:42.256414 3486 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:42.256624 3486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:42.256868 3486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:42.261683 3495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:42.261770 3491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:42.261862 3492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:42.262033 3486 server_base.cc:1034] running on GCE node
I20260807 20:17:42.262249 3486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:42.262467 3486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:42.263605 3486 hybrid_clock.cc:648] HybridClock initialized: now 1786133862263595 us; error 27 us; skew 500 ppm
Aug 07 20:17:42 dist-test-slave-t7g5 krb5kdc[3106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133862, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:42.266095 3486 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:17:42.266546 3486 webserver.cc:460] Webserver started at http://127.30.35.194:45703/ using document root <none> and password file <none>
I20260807 20:17:42.266749 3486 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:42.266798 3486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:42.266929 3486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:42.267928 3486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "45055c1e5aef44b38b2c1bbb82987331"
format_stamp: "Formatted at 2026-08-07 20:17:42 on dist-test-slave-t7g5"
server_key: "14bdce093710d5e7b18c0a1ab223be03"
server_key_iv: "363f152df53e12743b4880db33f86535"
server_key_version: "encryptionkey@0"
I20260807 20:17:42.268271 3486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "45055c1e5aef44b38b2c1bbb82987331"
format_stamp: "Formatted at 2026-08-07 20:17:42 on dist-test-slave-t7g5"
server_key: "14bdce093710d5e7b18c0a1ab223be03"
server_key_iv: "363f152df53e12743b4880db33f86535"
server_key_version: "encryptionkey@0"
I20260807 20:17:42.269516 3486 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260807 20:17:42.270251 3508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:42.270414 3486 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:42.270498 3486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "45055c1e5aef44b38b2c1bbb82987331"
format_stamp: "Formatted at 2026-08-07 20:17:42 on dist-test-slave-t7g5"
server_key: "14bdce093710d5e7b18c0a1ab223be03"
server_key_iv: "363f152df53e12743b4880db33f86535"
server_key_version: "encryptionkey@0"
I20260807 20:17:42.270565 3486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:42.290125 3486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:42.292276 3486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:42.292428 3486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:42.292654 3486 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:42.292965 3486 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:42.293000 3486 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:42.293030 3486 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:42.293053 3486 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:42.298730 3486 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:41963
I20260807 20:17:42.298799 3705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:41963 every 8 connection(s)
I20260807 20:17:42.299108 3486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
Aug 07 20:17:42 dist-test-slave-t7g5 krb5kdc[3106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133862, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:42.305531 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 3486
I20260807 20:17:42.305630 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:17:42.305838 30863 external_mini_cluster.cc:1428] Setting key 3e97e4231d3affcd9ba6203098099429
I20260807 20:17:42.308473 3266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:42.299849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:42547 (local address 127.30.35.254:36649)
0807 20:17:42.299944 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:42.299946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:42.300103 (+ 157us) server_negotiation.cc:407] Connection header received
0807 20:17:42.300646 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:42.300647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:42.300665 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:42.300715 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:42.301714 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:42.302229 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:42.303245 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:42.303444 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:42.303502 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:42.305603 (+ 2101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:42.305605 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:42.305605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:42.305613 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:42.307151 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:42.307542 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:42.307543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:42.307543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:42.307603 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:42.307825 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:42.307826 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:42.307826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:42.307943 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:42.308001 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:42.308325 (+ 324us) server_negotiation.cc:299] Negotiation successful
0807 20:17:42.308406 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 20:17:42.308698 3711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:42.299773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:36649 (local address 127.30.35.194:42547)
0807 20:17:42.299970 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:42.300009 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:42.300534 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:42.300820 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:42.300823 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:42.301417 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:42.301610 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:42.301615 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:42.302326 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:42.302327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:42.303150 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:42.303153 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:42.303516 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:42.303517 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:42.303635 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:42.304111 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:42.304121 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:42.305511 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:42.307231 (+ 1720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:42.307239 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:42.307241 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:42.307473 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:42.307657 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:42.307658 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:42.307658 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:42.307766 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:42.307998 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:42.308005 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:42.308181 (+ 176us) client_negotiation.cc:769] Sending connection context
0807 20:17:42.308297 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 20:17:42.308472 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":86,"threads_started":1}
I20260807 20:17:42.309180 3707 heartbeater.cc:347] Connected to a master server at 127.30.35.254:36649
I20260807 20:17:42.309284 3707 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:42.309464 3707 heartbeater.cc:511] Master 127.30.35.254:36649 requested a full tablet report, sending...
I20260807 20:17:42.309872 3180 ts_manager.cc:194] Registered new tserver with Master: 45055c1e5aef44b38b2c1bbb82987331 (127.30.35.194:41963)
I20260807 20:17:42.310333 3180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:42547
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:17:42.330641 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36649
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:40537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:42.413594 3718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:42.413882 3718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:42.413910 3718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:42.415076 3718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:42.415126 3718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:42.415158 3718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:17:42.416667 3718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:42.416947 3718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:42.417203 3718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:42.422360 3731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:42.422345 3728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:42.422391 3733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:42.422600 3718 server_base.cc:1034] running on GCE node
I20260807 20:17:42.422819 3718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:42.423040 3718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:42.424211 3718 hybrid_clock.cc:648] HybridClock initialized: now 1786133862424188 us; error 36 us; skew 500 ppm
Aug 07 20:17:42 dist-test-slave-t7g5 krb5kdc[3106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133862, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:42.426826 3718 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:17:42.427349 3718 webserver.cc:460] Webserver started at http://127.30.35.195:42029/ using document root <none> and password file <none>
I20260807 20:17:42.427572 3718 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:42.427620 3718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:42.427757 3718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:42.429082 3718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "4b9be63855204f699600fcb6bfdaa231"
format_stamp: "Formatted at 2026-08-07 20:17:42 on dist-test-slave-t7g5"
server_key: "82e0b7659998c82f9cdc8e0bced157fa"
server_key_iv: "20c17d0474bbee8d2f7975019453f241"
server_key_version: "encryptionkey@0"
I20260807 20:17:42.429438 3718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "4b9be63855204f699600fcb6bfdaa231"
format_stamp: "Formatted at 2026-08-07 20:17:42 on dist-test-slave-t7g5"
server_key: "82e0b7659998c82f9cdc8e0bced157fa"
server_key_iv: "20c17d0474bbee8d2f7975019453f241"
server_key_version: "encryptionkey@0"
I20260807 20:17:42.430742 3718 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:17:42.431425 3741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:42.431583 3718 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:42.431666 3718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "4b9be63855204f699600fcb6bfdaa231"
format_stamp: "Formatted at 2026-08-07 20:17:42 on dist-test-slave-t7g5"
server_key: "82e0b7659998c82f9cdc8e0bced157fa"
server_key_iv: "20c17d0474bbee8d2f7975019453f241"
server_key_version: "encryptionkey@0"
I20260807 20:17:42.431735 3718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:42.445226 3718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:42.447383 3718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:42.447525 3718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:42.447731 3718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:42.448022 3718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:42.448057 3718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:42.448086 3718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:42.448104 3718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:42.453637 3718 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:37771
I20260807 20:17:42.453706 3926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:37771 every 8 connection(s)
I20260807 20:17:42.454010 3718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:17:42.455925 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 3718
I20260807 20:17:42.456033 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:17:42.456247 30863 external_mini_cluster.cc:1428] Setting key a8ca9d4fb3b2e205b6f6a421e4fb7dd0
Aug 07 20:17:42 dist-test-slave-t7g5 krb5kdc[3106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133862, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:42.463261 3266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:42.454701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:37827 (local address 127.30.35.254:36649)
0807 20:17:42.454753 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:42.454755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:42.454937 (+ 182us) server_negotiation.cc:407] Connection header received
0807 20:17:42.455438 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:42.455440 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:42.455453 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:42.455518 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:42.456803 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:42.457474 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:42.458567 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:42.458774 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:42.458834 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:42.460831 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:42.460832 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:42.460833 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:42.460840 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:42.462066 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:42.462446 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:42.462446 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:42.462447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:42.462504 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:42.462692 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:42.462692 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:42.462693 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:42.462828 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:42.462883 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:42.463124 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 20:17:42.463188 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 20:17:42.463436 3930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:42.454671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:36649 (local address 127.30.35.195:37827)
0807 20:17:42.454817 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:42.454854 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:42.455334 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:42.455602 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:42.455606 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:42.456429 (+ 823us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:42.456702 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:42.456709 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:42.457552 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:42.457553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:42.458497 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:42.458500 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:42.458839 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:42.458839 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:42.458944 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:42.459356 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:42.459364 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:42.460742 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:42.462145 (+ 1403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:42.462151 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:42.462153 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:42.462380 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:42.462552 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:42.462553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:42.462553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:42.462647 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:42.462888 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:42.462894 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:42.463014 (+ 120us) client_negotiation.cc:769] Sending connection context
0807 20:17:42.463102 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 20:17:42.463223 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
I20260807 20:17:42.463945 3927 heartbeater.cc:347] Connected to a master server at 127.30.35.254:36649
I20260807 20:17:42.464037 3927 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:42.464184 3927 heartbeater.cc:511] Master 127.30.35.254:36649 requested a full tablet report, sending...
I20260807 20:17:42.464552 3180 ts_manager.cc:194] Registered new tserver with Master: 4b9be63855204f699600fcb6bfdaa231 (127.30.35.195:37771)
I20260807 20:17:42.464922 3180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:37827
I20260807 20:17:42.467973 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 20:17:42 dist-test-slave-t7g5 krb5kdc[3106](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133862, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 20:17:42 dist-test-slave-t7g5 krb5kdc[3106](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133862, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:42.491164 3266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:42.484276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48202 (local address 127.30.35.254:36649)
0807 20:17:42.484344 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:42.484347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:42.484428 (+ 81us) server_negotiation.cc:407] Connection header received
0807 20:17:42.484497 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:42.484498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:42.484508 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:42.484560 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:42.485165 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:42.485736 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:42.486435 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:42.486614 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:42.486652 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:42.488987 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:42.488989 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:42.488989 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:42.488996 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:42.490180 (+ 1184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:42.490488 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:42.490489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:42.490489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:42.490537 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:42.490682 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:42.490683 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:42.490683 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:42.490825 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:42.490903 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:42.491001 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 20:17:42.491066 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260807 20:17:42.491566 3180 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:48202
I20260807 20:17:42.492074 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 3275
I20260807 20:17:42.509406 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 3486
I20260807 20:17:42.519579 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 3718
I20260807 20:17:42.533923 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 3122
2026-08-07T20:17:42Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1983 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:17:42 dist-test-slave-t7g5 krb5kdc[3948](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:17:42 dist-test-slave-t7g5 krb5kdc[3948](info): set up 2 sockets
Aug 07 20:17:42 dist-test-slave-t7g5 krb5kdc[3948](info): commencing operation
krb5kdc: starting...
W20260807 20:17:43.663919 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:17:43 dist-test-slave-t7g5 krb5kdc[3948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:17:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:17:43.782426 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:38925
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:35209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:38925
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:43.865015 3971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:43.865253 3971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:43.865284 3971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:43.866501 3971 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:43.866554 3971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:43.866570 3971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:43.866587 3971 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:43.866602 3971 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:43.868364 3971 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:35209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:38925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:38925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:43.868641 3971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:43.868870 3971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:43.873482 3979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:43.873528 3980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:43.873591 3971 server_base.cc:1034] running on GCE node
W20260807 20:17:43.873522 3983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:43.874006 3971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:43.874292 3971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:43.875437 3971 hybrid_clock.cc:648] HybridClock initialized: now 1786133863875419 us; error 30 us; skew 500 ppm
Aug 07 20:17:43 dist-test-slave-t7g5 krb5kdc[3948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133863, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:43.877964 3971 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:17:43.878369 3971 webserver.cc:460] Webserver started at http://127.30.35.254:34397/ using document root <none> and password file <none>
I20260807 20:17:43.878587 3971 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:43.878635 3971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:43.878762 3971 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:43.879791 3971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "9dedda41b2ac422ab57d9333162ab03c"
format_stamp: "Formatted at 2026-08-07 20:17:43 on dist-test-slave-t7g5"
server_key: "94c32397ce6180c85a6ff176f76212f9"
server_key_iv: "9a16834451b66d0c403a38dbdada16a3"
server_key_version: "encryptionkey@0"
I20260807 20:17:43.880141 3971 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "9dedda41b2ac422ab57d9333162ab03c"
format_stamp: "Formatted at 2026-08-07 20:17:43 on dist-test-slave-t7g5"
server_key: "94c32397ce6180c85a6ff176f76212f9"
server_key_iv: "9a16834451b66d0c403a38dbdada16a3"
server_key_version: "encryptionkey@0"
I20260807 20:17:43.881372 3971 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:43.882085 3992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:43.882256 3971 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:43.882344 3971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "9dedda41b2ac422ab57d9333162ab03c"
format_stamp: "Formatted at 2026-08-07 20:17:43 on dist-test-slave-t7g5"
server_key: "94c32397ce6180c85a6ff176f76212f9"
server_key_iv: "9a16834451b66d0c403a38dbdada16a3"
server_key_version: "encryptionkey@0"
I20260807 20:17:43.882416 3971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:43.894572 3971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:43.896440 3971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:43.896590 3971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:43.900590 3971 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:38925
I20260807 20:17:43.900638 4086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:38925 every 8 connection(s)
I20260807 20:17:43.901132 3971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:43.901867 4089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:43.904255 4089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c: Bootstrap starting.
I20260807 20:17:43.904853 4089 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:43.905128 4089 log.cc:824] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:43.905853 4089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c: No bootstrap required, opened a new log
I20260807 20:17:43.907414 4089 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dedda41b2ac422ab57d9333162ab03c" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38925 } }
I20260807 20:17:43.907562 4089 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:43.907583 4089 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dedda41b2ac422ab57d9333162ab03c, State: Initialized, Role: FOLLOWER
I20260807 20:17:43.907650 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 3971
I20260807 20:17:43.907748 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:43.907727 4089 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dedda41b2ac422ab57d9333162ab03c" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38925 } }
I20260807 20:17:43.907796 4089 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:43.907835 4089 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:43.907881 4089 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:43.907939 30863 external_mini_cluster.cc:1428] Setting key bee909bde44baae27045db5cdd4838d3
I20260807 20:17:43.908918 4089 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dedda41b2ac422ab57d9333162ab03c" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38925 } }
I20260807 20:17:43.909039 4089 leader_election.cc:302] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9dedda41b2ac422ab57d9333162ab03c; no voters:
I20260807 20:17:43.909210 4089 leader_election.cc:288] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:43.909246 4097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:43.909404 4097 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [term 1 LEADER]: Becoming Leader. State: Replica: 9dedda41b2ac422ab57d9333162ab03c, State: Running, Role: LEADER
I20260807 20:17:43.909488 4089 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:43.909545 4097 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dedda41b2ac422ab57d9333162ab03c" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38925 } }
I20260807 20:17:43.909940 4097 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9dedda41b2ac422ab57d9333162ab03c. Latest consensus state: current_term: 1 leader_uuid: "9dedda41b2ac422ab57d9333162ab03c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dedda41b2ac422ab57d9333162ab03c" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38925 } } }
I20260807 20:17:43.910172 4097 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:43.910099 4101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9dedda41b2ac422ab57d9333162ab03c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dedda41b2ac422ab57d9333162ab03c" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38925 } } }
I20260807 20:17:43.910549 4101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c [sys.catalog]: This master's current role is: LEADER
W20260807 20:17:43.911329 4122 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:17:43.911388 4122 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:17:43.911437 4112 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:43.911588 4112 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:43.914034 4112 catalog_manager.cc:1347] Generated new cluster ID: 713a56a2405a42f286f2302bdcd99b3b
I20260807 20:17:43.914084 4112 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:17:43 dist-test-slave-t7g5 krb5kdc[3948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:43.918748 4112 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:43.919116 4096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:43.908421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57768 (local address 127.30.35.254:38925)
0807 20:17:43.908594 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:43.908602 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:43.908627 (+ 25us) server_negotiation.cc:407] Connection header received
0807 20:17:43.908721 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:43.908727 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:43.908775 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:43.908885 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:43.909774 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:43.911199 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:43.912048 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:43.912622 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:43.912734 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:43.915401 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:43.915406 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:43.915406 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:43.915420 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:43.917368 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:43.917802 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:43.917805 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:43.917806 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:43.917940 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:43.918144 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:43.918144 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:43.918145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:43.918440 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:43.918614 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:43.918741 (+ 127us) server_negotiation.cc:299] Negotiation successful
0807 20:17:43.918897 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
I20260807 20:17:43.919353 4112 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:43.924419 4112 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9dedda41b2ac422ab57d9333162ab03c: Generated new TSK 0
I20260807 20:17:43.924582 4112 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:17:43.956892 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:38925
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:35209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:44.040853 4133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:44.041070 4133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:44.041095 4133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:44.042364 4133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:44.042414 4133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:44.042444 4133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:17:44.044006 4133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:35209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:38925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:44.044252 4133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:44.044471 4133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:44.049531 4138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:44.049533 4141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:44.049533 4144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:44.049810 4133 server_base.cc:1034] running on GCE node
I20260807 20:17:44.050091 4133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:44.050302 4133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:44.051433 4133 hybrid_clock.cc:648] HybridClock initialized: now 1786133864051415 us; error 34 us; skew 500 ppm
Aug 07 20:17:44 dist-test-slave-t7g5 krb5kdc[3948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133864, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:44.053975 4133 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:17:44.054409 4133 webserver.cc:460] Webserver started at http://127.30.35.193:36587/ using document root <none> and password file <none>
I20260807 20:17:44.054636 4133 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:44.054684 4133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:44.054814 4133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:44.055864 4133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "893b7080e983437cadbc06a619a77091"
format_stamp: "Formatted at 2026-08-07 20:17:44 on dist-test-slave-t7g5"
server_key: "f0049f4a877c8b099c5e3d95869f1cfa"
server_key_iv: "ec57bc602729ebc4180693c0ff58fed9"
server_key_version: "encryptionkey@0"
I20260807 20:17:44.056198 4133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "893b7080e983437cadbc06a619a77091"
format_stamp: "Formatted at 2026-08-07 20:17:44 on dist-test-slave-t7g5"
server_key: "f0049f4a877c8b099c5e3d95869f1cfa"
server_key_iv: "ec57bc602729ebc4180693c0ff58fed9"
server_key_version: "encryptionkey@0"
I20260807 20:17:44.057430 4133 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:44.058142 4158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:44.058293 4133 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:44.058379 4133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "893b7080e983437cadbc06a619a77091"
format_stamp: "Formatted at 2026-08-07 20:17:44 on dist-test-slave-t7g5"
server_key: "f0049f4a877c8b099c5e3d95869f1cfa"
server_key_iv: "ec57bc602729ebc4180693c0ff58fed9"
server_key_version: "encryptionkey@0"
I20260807 20:17:44.058449 4133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:44.067402 4133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:44.069087 4133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:44.069226 4133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:44.069438 4133 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:44.069759 4133 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:44.069795 4133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:44.069826 4133 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:44.069846 4133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:44.075321 4133 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:41251
I20260807 20:17:44.075383 4343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:41251 every 8 connection(s)
I20260807 20:17:44.075693 4133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
Aug 07 20:17:44 dist-test-slave-t7g5 krb5kdc[3948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133864, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:44.082178 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 4133
I20260807 20:17:44.082286 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:17:44.082489 30863 external_mini_cluster.cc:1428] Setting key da2eb560ad56a123b67417bfacb536d0
I20260807 20:17:44.085310 4096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:44.076419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:55005 (local address 127.30.35.254:38925)
0807 20:17:44.076469 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:44.076472 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:44.076667 (+ 195us) server_negotiation.cc:407] Connection header received
0807 20:17:44.077746 (+ 1079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:44.077747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:44.077761 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:44.077810 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:44.078414 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.078939 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.079871 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.080074 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.080119 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:44.082360 (+ 2241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:44.082361 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:44.082362 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:44.082373 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:44.083828 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:44.084283 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:44.084284 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:44.084284 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:44.084347 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:44.084622 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:44.084623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:44.084623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:44.084765 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:44.084839 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:44.085112 (+ 273us) server_negotiation.cc:299] Negotiation successful
0807 20:17:44.085215 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:17:44.085418 4346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:44.076391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:38925 (local address 127.30.35.193:55005)
0807 20:17:44.076552 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:44.076588 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:44.077594 (+ 1006us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:44.077872 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:44.077875 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:44.078147 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:44.078344 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:44.078349 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.079001 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.079002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:44.079813 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:44.079815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.080127 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.080128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:44.080227 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:44.080734 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:44.080743 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:44.082261 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:44.083913 (+ 1652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:44.083921 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:44.083924 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:44.084213 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:44.084406 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:44.084406 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:44.084407 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:44.084565 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:44.084827 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:44.084832 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:44.084989 (+ 157us) client_negotiation.cc:769] Sending connection context
0807 20:17:44.085079 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 20:17:44.085232 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":90,"threads_started":1}
I20260807 20:17:44.085935 4344 heartbeater.cc:347] Connected to a master server at 127.30.35.254:38925
I20260807 20:17:44.086035 4344 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:44.086234 4344 heartbeater.cc:511] Master 127.30.35.254:38925 requested a full tablet report, sending...
I20260807 20:17:44.086792 4022 ts_manager.cc:194] Registered new tserver with Master: 893b7080e983437cadbc06a619a77091 (127.30.35.193:41251)
I20260807 20:17:44.087656 4022 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:55005
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:17:44.108724 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:38925
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:35209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:44.191094 4349 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:44.191366 4349 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:44.191402 4349 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:44.193028 4349 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:44.193089 4349 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:44.193125 4349 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:17:44.195051 4349 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:35209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:38925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4349
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:44.195300 4349 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:44.195546 4349 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:44.200359 4355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:44.200363 4362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:44.200407 4359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:44.200556 4349 server_base.cc:1034] running on GCE node
I20260807 20:17:44.200834 4349 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:44.201050 4349 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:44.202183 4349 hybrid_clock.cc:648] HybridClock initialized: now 1786133864202163 us; error 34 us; skew 500 ppm
Aug 07 20:17:44 dist-test-slave-t7g5 krb5kdc[3948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133864, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:44.204522 4349 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:17:44.204924 4349 webserver.cc:460] Webserver started at http://127.30.35.194:41373/ using document root <none> and password file <none>
I20260807 20:17:44.205127 4349 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:44.205174 4349 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:44.205298 4349 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:44.206344 4349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "478852ee0f204a8e8df3161749faf439"
format_stamp: "Formatted at 2026-08-07 20:17:44 on dist-test-slave-t7g5"
server_key: "05beba5708d6a88b752496858eb894f7"
server_key_iv: "d895751eb49815a5b3280b7af257ccb7"
server_key_version: "encryptionkey@0"
I20260807 20:17:44.206674 4349 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "478852ee0f204a8e8df3161749faf439"
format_stamp: "Formatted at 2026-08-07 20:17:44 on dist-test-slave-t7g5"
server_key: "05beba5708d6a88b752496858eb894f7"
server_key_iv: "d895751eb49815a5b3280b7af257ccb7"
server_key_version: "encryptionkey@0"
I20260807 20:17:44.207893 4349 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:44.208523 4371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:44.208664 4349 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:44.208747 4349 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "478852ee0f204a8e8df3161749faf439"
format_stamp: "Formatted at 2026-08-07 20:17:44 on dist-test-slave-t7g5"
server_key: "05beba5708d6a88b752496858eb894f7"
server_key_iv: "d895751eb49815a5b3280b7af257ccb7"
server_key_version: "encryptionkey@0"
I20260807 20:17:44.208804 4349 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:44.229946 4349 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:44.232116 4349 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:44.232254 4349 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:44.232476 4349 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:44.232779 4349 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:44.232810 4349 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:44.232832 4349 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:44.232854 4349 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:44.238340 4349 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:43417
I20260807 20:17:44.238385 4566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:43417 every 8 connection(s)
I20260807 20:17:44.238684 4349 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:17:44.244164 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 4349
I20260807 20:17:44.244287 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:17:44.244486 30863 external_mini_cluster.cc:1428] Setting key 2f94907d22fc82a15f0ebcafa492bedd
Aug 07 20:17:44 dist-test-slave-t7g5 krb5kdc[3948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133864, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:44.247908 4096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:44.239373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:53577 (local address 127.30.35.254:38925)
0807 20:17:44.239431 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:44.239433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:44.239630 (+ 197us) server_negotiation.cc:407] Connection header received
0807 20:17:44.240592 (+ 962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:44.240593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:44.240608 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:44.240661 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:44.241289 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.241834 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.242789 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.242985 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.243042 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:44.245191 (+ 2149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:44.245193 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:44.245193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:44.245202 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:44.246647 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:44.247028 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:44.247029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:44.247029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:44.247086 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:44.247299 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:44.247300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:44.247301 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:44.247404 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:44.247472 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:44.247726 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 20:17:44.247818 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 20:17:44.248065 4569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:44.239333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:38925 (local address 127.30.35.194:53577)
0807 20:17:44.239510 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:44.239545 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:44.240481 (+ 936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:44.240742 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:44.240746 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:44.241002 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:44.241191 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:44.241196 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.241919 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.241920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:44.242709 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:44.242711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.243054 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.243054 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:44.243177 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:44.243565 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:44.243574 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:44.245099 (+ 1525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:44.246730 (+ 1631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:44.246736 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:44.246738 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:44.246956 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:44.247142 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:44.247143 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:44.247143 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:44.247244 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:44.247470 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:44.247477 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:44.247610 (+ 133us) client_negotiation.cc:769] Sending connection context
0807 20:17:44.247699 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 20:17:44.247843 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":99,"threads_started":1}
I20260807 20:17:44.248536 4567 heartbeater.cc:347] Connected to a master server at 127.30.35.254:38925
I20260807 20:17:44.248638 4567 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:44.248817 4567 heartbeater.cc:511] Master 127.30.35.254:38925 requested a full tablet report, sending...
I20260807 20:17:44.249150 4022 ts_manager.cc:194] Registered new tserver with Master: 478852ee0f204a8e8df3161749faf439 (127.30.35.194:43417)
I20260807 20:17:44.249507 4022 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:53577
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:17:44.269448 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:38925
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:35209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:44.349942 4575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:44.350145 4575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:44.350167 4575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:44.351233 4575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:44.351265 4575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:44.351289 4575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:17:44.352694 4575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:35209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:38925
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:44.352886 4575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:44.353060 4575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:44.357686 4594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:44.357686 4589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:44.357743 4591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:44.357867 4575 server_base.cc:1034] running on GCE node
I20260807 20:17:44.358112 4575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:44.358331 4575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:44.359464 4575 hybrid_clock.cc:648] HybridClock initialized: now 1786133864359448 us; error 27 us; skew 500 ppm
Aug 07 20:17:44 dist-test-slave-t7g5 krb5kdc[3948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133864, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:44.361863 4575 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:17:44.362323 4575 webserver.cc:460] Webserver started at http://127.30.35.195:44939/ using document root <none> and password file <none>
I20260807 20:17:44.362527 4575 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:44.362574 4575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:44.362699 4575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:44.363665 4575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "19467f757a4b4522a4847d1cdc76ed58"
format_stamp: "Formatted at 2026-08-07 20:17:44 on dist-test-slave-t7g5"
server_key: "091aa938c5e2819c00f9cd80c2558678"
server_key_iv: "f19b1406c72e0abad8d0113345342b47"
server_key_version: "encryptionkey@0"
I20260807 20:17:44.363996 4575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "19467f757a4b4522a4847d1cdc76ed58"
format_stamp: "Formatted at 2026-08-07 20:17:44 on dist-test-slave-t7g5"
server_key: "091aa938c5e2819c00f9cd80c2558678"
server_key_iv: "f19b1406c72e0abad8d0113345342b47"
server_key_version: "encryptionkey@0"
I20260807 20:17:44.365202 4575 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:17:44.365865 4606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:44.366008 4575 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:44.366093 4575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "19467f757a4b4522a4847d1cdc76ed58"
format_stamp: "Formatted at 2026-08-07 20:17:44 on dist-test-slave-t7g5"
server_key: "091aa938c5e2819c00f9cd80c2558678"
server_key_iv: "f19b1406c72e0abad8d0113345342b47"
server_key_version: "encryptionkey@0"
I20260807 20:17:44.366158 4575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:44.378568 4575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:44.380167 4575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:44.380299 4575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:44.380501 4575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:44.380779 4575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:44.380812 4575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:44.380839 4575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:44.380856 4575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:44.386412 4575 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:43299
I20260807 20:17:44.386456 4785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:43299 every 8 connection(s)
I20260807 20:17:44.386742 4575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
Aug 07 20:17:44 dist-test-slave-t7g5 krb5kdc[3948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133864, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:44.394665 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 4575
I20260807 20:17:44.394752 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:17:44.394953 30863 external_mini_cluster.cc:1428] Setting key 23308312efc8abb62ad3e7aae87fac52
I20260807 20:17:44.395773 4096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:44.387428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:41803 (local address 127.30.35.254:38925)
0807 20:17:44.387482 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:44.387484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:44.387684 (+ 200us) server_negotiation.cc:407] Connection header received
0807 20:17:44.388604 (+ 920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:44.388605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:44.388619 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:44.388671 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:44.389300 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.389853 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.390806 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.391000 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.391056 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:44.393048 (+ 1992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:44.393049 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:44.393049 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:44.393056 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:44.394302 (+ 1246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:44.394666 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:44.394667 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:44.394667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:44.394724 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:44.395094 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:44.395095 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:44.395095 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:44.395236 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:44.395299 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:44.395605 (+ 306us) server_negotiation.cc:299] Negotiation successful
0807 20:17:44.395689 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 20:17:44.395948 4793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:44.387406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:38925 (local address 127.30.35.195:41803)
0807 20:17:44.387574 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:44.387610 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:44.388503 (+ 893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:44.388742 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:44.388746 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:44.389020 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:44.389211 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:44.389216 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.389935 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.389936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:44.390719 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:44.390722 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.391069 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.391070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:44.391190 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:44.391656 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:44.391665 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:44.392959 (+ 1294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:44.394375 (+ 1416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:44.394382 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:44.394384 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:44.394600 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:44.394838 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:44.394840 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:44.394840 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:44.395009 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:44.395300 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:44.395305 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:44.395477 (+ 172us) client_negotiation.cc:769] Sending connection context
0807 20:17:44.395572 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 20:17:44.395727 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
I20260807 20:17:44.396364 4789 heartbeater.cc:347] Connected to a master server at 127.30.35.254:38925
I20260807 20:17:44.396458 4789 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:44.396626 4789 heartbeater.cc:511] Master 127.30.35.254:38925 requested a full tablet report, sending...
I20260807 20:17:44.396974 4022 ts_manager.cc:194] Registered new tserver with Master: 19467f757a4b4522a4847d1cdc76ed58 (127.30.35.195:43299)
I20260807 20:17:44.397318 4022 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:41803
I20260807 20:17:44.406653 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 20:17:44 dist-test-slave-t7g5 krb5kdc[3948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 20:17:44 dist-test-slave-t7g5 krb5kdc[3948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.193@KRBTEST.COM
I20260807 20:17:44.429152 4803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:44.422287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35842 (local address 127.30.35.193:41251)
0807 20:17:44.422440 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:44.422445 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:44.422456 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:17:44.422483 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:44.422485 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:44.422498 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:44.422563 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:44.423063 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.423751 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.424474 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.424868 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.424934 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:44.426966 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:44.426974 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:44.426974 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:44.426980 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:44.428246 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:44.428541 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:44.428543 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:44.428543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:44.428597 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:44.428731 (+ 134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:44.428732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:44.428732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:44.428852 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:44.428975 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:44.429009 (+ 34us) server_negotiation.cc:299] Negotiation successful
0807 20:17:44.429071 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":67,"threads_started":1}
Aug 07 20:17:44 dist-test-slave-t7g5 krb5kdc[3948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:44.436285 4096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:44.430433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57774 (local address 127.30.35.254:38925)
0807 20:17:44.430476 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:44.430478 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:44.430486 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:44.430533 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:44.430535 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:44.430543 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:44.430577 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:44.430966 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.431434 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.432028 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:44.432195 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:44.432235 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:44.434083 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:44.434085 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:44.434085 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:44.434092 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:44.435247 (+ 1155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:44.435557 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:44.435558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:44.435559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:44.435614 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:44.435772 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:44.435773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:44.435773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:44.435908 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:44.435999 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:44.436127 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 20:17:44.436195 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 20:17:44.436508 4022 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57774
I20260807 20:17:44.436798 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 4133
I20260807 20:17:44.451120 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 4349
I20260807 20:17:44.461489 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 4575
I20260807 20:17:44.473404 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 3971
2026-08-07T20:17:44Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1937 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:17:44 dist-test-slave-t7g5 krb5kdc[4809](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:17:44 dist-test-slave-t7g5 krb5kdc[4809](info): set up 2 sockets
Aug 07 20:17:44 dist-test-slave-t7g5 krb5kdc[4809](info): commencing operation
krb5kdc: starting...
W20260807 20:17:45.616564 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:17:45 dist-test-slave-t7g5 krb5kdc[4809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:17:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:17:45.731701 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:38787
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:36273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:38787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:45.811039 4829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:45.811244 4829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:45.811275 4829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:45.812390 4829 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:45.812430 4829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:45.812448 4829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:45.812464 4829 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:45.812479 4829 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:45.813946 4829 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:38787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:38787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:45.814180 4829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:45.814374 4829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:45.819185 4841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:45.819216 4842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:45.819278 4829 server_base.cc:1034] running on GCE node
W20260807 20:17:45.819171 4845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:45.819556 4829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:45.819813 4829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:45.820966 4829 hybrid_clock.cc:648] HybridClock initialized: now 1786133865820951 us; error 28 us; skew 500 ppm
Aug 07 20:17:45 dist-test-slave-t7g5 krb5kdc[4809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133865, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:45.827641 4829 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:17:45.827979 4829 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:45.828030 4829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:45.828151 4829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:45.829159 4829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "32dff371dc0d4a979d97e3c56bc52d30"
format_stamp: "Formatted at 2026-08-07 20:17:45 on dist-test-slave-t7g5"
server_key: "d8d9f52363922cc8b6c8a24f7a8dee8d"
server_key_iv: "8ec92a68cef294d18c0efb9983528358"
server_key_version: "encryptionkey@0"
I20260807 20:17:45.829480 4829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "32dff371dc0d4a979d97e3c56bc52d30"
format_stamp: "Formatted at 2026-08-07 20:17:45 on dist-test-slave-t7g5"
server_key: "d8d9f52363922cc8b6c8a24f7a8dee8d"
server_key_iv: "8ec92a68cef294d18c0efb9983528358"
server_key_version: "encryptionkey@0"
I20260807 20:17:45.830670 4829 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:17:45.831310 4853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:45.831466 4829 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:45.831559 4829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "32dff371dc0d4a979d97e3c56bc52d30"
format_stamp: "Formatted at 2026-08-07 20:17:45 on dist-test-slave-t7g5"
server_key: "d8d9f52363922cc8b6c8a24f7a8dee8d"
server_key_iv: "8ec92a68cef294d18c0efb9983528358"
server_key_version: "encryptionkey@0"
I20260807 20:17:45.831624 4829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:45.851989 4829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:45.854266 4829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:45.854388 4829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:45.858335 4829 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:38787
I20260807 20:17:45.858363 4940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:38787 every 8 connection(s)
I20260807 20:17:45.858651 4829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:45.859696 4941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:45.862115 4941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30: Bootstrap starting.
I20260807 20:17:45.862708 4941 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:45.862995 4941 log.cc:824] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:45.863646 4941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30: No bootstrap required, opened a new log
I20260807 20:17:45.865239 4941 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32dff371dc0d4a979d97e3c56bc52d30" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38787 } }
I20260807 20:17:45.865391 4941 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:45.865413 4941 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32dff371dc0d4a979d97e3c56bc52d30, State: Initialized, Role: FOLLOWER
I20260807 20:17:45.865571 4941 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32dff371dc0d4a979d97e3c56bc52d30" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38787 } }
I20260807 20:17:45.865638 4941 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:45.865693 4941 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:45.865749 4941 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:45.866355 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 4829
I20260807 20:17:45.866479 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:45.866657 30863 external_mini_cluster.cc:1428] Setting key f2f3df0949b806e29ce2886550a7c4a7
I20260807 20:17:45.866745 4941 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32dff371dc0d4a979d97e3c56bc52d30" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38787 } }
I20260807 20:17:45.866860 4941 leader_election.cc:302] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32dff371dc0d4a979d97e3c56bc52d30; no voters:
I20260807 20:17:45.867053 4941 leader_election.cc:288] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:45.867096 4946 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:45.867321 4946 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [term 1 LEADER]: Becoming Leader. State: Replica: 32dff371dc0d4a979d97e3c56bc52d30, State: Running, Role: LEADER
I20260807 20:17:45.867424 4941 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:45.867450 4946 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32dff371dc0d4a979d97e3c56bc52d30" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38787 } }
I20260807 20:17:45.867825 4946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32dff371dc0d4a979d97e3c56bc52d30. Latest consensus state: current_term: 1 leader_uuid: "32dff371dc0d4a979d97e3c56bc52d30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32dff371dc0d4a979d97e3c56bc52d30" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38787 } } }
I20260807 20:17:45.867993 4946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:45.867837 4950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32dff371dc0d4a979d97e3c56bc52d30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32dff371dc0d4a979d97e3c56bc52d30" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38787 } } }
I20260807 20:17:45.868146 4950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30 [sys.catalog]: This master's current role is: LEADER
W20260807 20:17:45.869616 4971 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:17:45.870651 4971 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:17:45.870733 4959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:45.870909 4959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:45.872742 4959 catalog_manager.cc:1347] Generated new cluster ID: 793ef0f93e2145bb9a424ab2c1d28041
I20260807 20:17:45.872795 4959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:17:45 dist-test-slave-t7g5 krb5kdc[4809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:45.879961 4952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:45.867216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57814 (local address 127.30.35.254:38787)
0807 20:17:45.867657 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:45.867667 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:45.867702 (+ 35us) server_negotiation.cc:407] Connection header received
0807 20:17:45.867829 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:45.867837 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:45.868416 (+ 579us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:45.868584 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:45.869354 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:45.870413 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:45.871460 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:45.872034 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:45.872136 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:45.874870 (+ 2734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:45.874875 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:45.874875 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:45.874898 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:45.878122 (+ 3224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:45.878484 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:45.878488 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:45.878488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:45.878590 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:45.878752 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:45.878752 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:45.878753 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:45.879051 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:45.879194 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:45.879593 (+ 399us) server_negotiation.cc:299] Negotiation successful
0807 20:17:45.879728 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":97,"threads_started":1}
I20260807 20:17:45.906358 4959 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:45.906906 4959 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:45.909574 4959 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30: Generated new TSK 0
I20260807 20:17:45.909789 4959 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:17:45.936933 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:38787
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:36273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:46.041524 4979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:46.041847 4979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:46.041878 4979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:46.043097 4979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:46.043140 4979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:46.043169 4979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:17:46.044706 4979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:38787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:46.044957 4979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:46.045186 4979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:46.050015 4991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:46.050027 4988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:46.050052 4986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:46.050205 4979 server_base.cc:1034] running on GCE node
I20260807 20:17:46.050443 4979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:46.050642 4979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:46.051772 4979 hybrid_clock.cc:648] HybridClock initialized: now 1786133866051755 us; error 34 us; skew 500 ppm
Aug 07 20:17:46 dist-test-slave-t7g5 krb5kdc[4809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133866, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:46.054304 4979 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:17:46.054616 4979 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:46.054662 4979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:46.054774 4979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:46.055799 4979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "128c274f64a2461c9b9f717776b61e6a"
format_stamp: "Formatted at 2026-08-07 20:17:46 on dist-test-slave-t7g5"
server_key: "7ce0b766b27d7f294a3fde1ab59314db"
server_key_iv: "e360950ce39bbcc95417b1a054330cf2"
server_key_version: "encryptionkey@0"
I20260807 20:17:46.056135 4979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "128c274f64a2461c9b9f717776b61e6a"
format_stamp: "Formatted at 2026-08-07 20:17:46 on dist-test-slave-t7g5"
server_key: "7ce0b766b27d7f294a3fde1ab59314db"
server_key_iv: "e360950ce39bbcc95417b1a054330cf2"
server_key_version: "encryptionkey@0"
I20260807 20:17:46.057336 4979 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:46.058091 5003 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:46.058267 4979 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:46.058353 4979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "128c274f64a2461c9b9f717776b61e6a"
format_stamp: "Formatted at 2026-08-07 20:17:46 on dist-test-slave-t7g5"
server_key: "7ce0b766b27d7f294a3fde1ab59314db"
server_key_iv: "e360950ce39bbcc95417b1a054330cf2"
server_key_version: "encryptionkey@0"
I20260807 20:17:46.058411 4979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:46.092478 4979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:46.094731 4979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:46.094877 4979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:46.095121 4979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:46.095444 4979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:46.095492 4979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:46.095522 4979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:46.095541 4979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:46.100776 4979 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:41973
I20260807 20:17:46.100840 5174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:41973 every 8 connection(s)
I20260807 20:17:46.101084 4979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:17:46.102634 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 4979
I20260807 20:17:46.102746 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:17:46.102938 30863 external_mini_cluster.cc:1428] Setting key 56ca9d4c985755036015f4309fb93ef1
Aug 07 20:17:46 dist-test-slave-t7g5 krb5kdc[4809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133866, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:46.110726 4952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.101775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:53147 (local address 127.30.35.254:38787)
0807 20:17:46.101855 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:46.101857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:46.102032 (+ 175us) server_negotiation.cc:407] Connection header received
0807 20:17:46.102503 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:46.102504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:46.102514 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:46.102557 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:46.103687 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.104174 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.105456 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.105699 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.105776 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.108045 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:46.108046 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:46.108046 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:46.108055 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:46.109352 (+ 1297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:46.109827 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:46.109827 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:46.109828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:46.109878 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:46.110130 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:46.110130 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:46.110130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:46.110228 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:46.110274 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:46.110588 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 20:17:46.110660 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260807 20:17:46.110973 5179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.101758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:38787 (local address 127.30.35.193:53147)
0807 20:17:46.101921 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:46.101956 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:46.102413 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:46.102638 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:46.102643 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:46.103002 (+ 359us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:46.103608 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.103617 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.104263 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.104264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.105370 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.105374 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.105789 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.105790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.105910 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.106352 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:46.106361 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:46.107953 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:46.109433 (+ 1480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:46.109441 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:46.109444 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:46.109760 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:46.109936 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:46.109936 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:46.109937 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:46.110075 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:46.110279 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:46.110285 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:46.110460 (+ 175us) client_negotiation.cc:769] Sending connection context
0807 20:17:46.110580 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 20:17:46.110742 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":93,"threads_started":1}
I20260807 20:17:46.111518 5176 heartbeater.cc:347] Connected to a master server at 127.30.35.254:38787
I20260807 20:17:46.111626 5176 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:46.111791 5176 heartbeater.cc:511] Master 127.30.35.254:38787 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
I20260807 20:17:46.112313 4882 ts_manager.cc:194] Registered new tserver with Master: 128c274f64a2461c9b9f717776b61e6a (127.30.35.193:41973)
I20260807 20:17:46.112890 4882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:53147
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:17:46.128458 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:38787
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:36273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:46.211006 5185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:46.211202 5185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:46.211231 5185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:46.212338 5185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:46.212379 5185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:46.212415 5185 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:17:46.213935 5185 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:38787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:46.214174 5185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:46.214375 5185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:46.218953 5197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:46.218963 5191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:46.218953 5194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:46.219218 5185 server_base.cc:1034] running on GCE node
I20260807 20:17:46.219480 5185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:46.219676 5185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:46.220803 5185 hybrid_clock.cc:648] HybridClock initialized: now 1786133866220784 us; error 35 us; skew 500 ppm
Aug 07 20:17:46 dist-test-slave-t7g5 krb5kdc[4809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133866, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:46.223189 5185 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:17:46.223515 5185 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:46.223563 5185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:46.223656 5185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:46.224635 5185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "fc9dd2f174d14c1983dc3791c3474f56"
format_stamp: "Formatted at 2026-08-07 20:17:46 on dist-test-slave-t7g5"
server_key: "d8a2c1554e6c408c1eb86d650963a7a8"
server_key_iv: "e9e106d9314fd868b5e712f982e9fb13"
server_key_version: "encryptionkey@0"
I20260807 20:17:46.224932 5185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "fc9dd2f174d14c1983dc3791c3474f56"
format_stamp: "Formatted at 2026-08-07 20:17:46 on dist-test-slave-t7g5"
server_key: "d8a2c1554e6c408c1eb86d650963a7a8"
server_key_iv: "e9e106d9314fd868b5e712f982e9fb13"
server_key_version: "encryptionkey@0"
I20260807 20:17:46.226107 5185 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:17:46.226725 5209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:46.226874 5185 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:46.226964 5185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "fc9dd2f174d14c1983dc3791c3474f56"
format_stamp: "Formatted at 2026-08-07 20:17:46 on dist-test-slave-t7g5"
server_key: "d8a2c1554e6c408c1eb86d650963a7a8"
server_key_iv: "e9e106d9314fd868b5e712f982e9fb13"
server_key_version: "encryptionkey@0"
I20260807 20:17:46.227020 5185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:46.241257 5185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:46.242993 5185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:46.243103 5185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:46.243285 5185 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:46.243573 5185 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:46.243605 5185 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:46.243633 5185 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:46.243656 5185 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:46.249109 5185 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:41307
I20260807 20:17:46.249181 5397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:41307 every 8 connection(s)
I20260807 20:17:46.249387 5185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:17:46.252924 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 5185
I20260807 20:17:46.253019 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:17:46.253201 30863 external_mini_cluster.cc:1428] Setting key f288eb7f64466aa63492474f23498d82
Aug 07 20:17:46 dist-test-slave-t7g5 krb5kdc[4809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133866, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:46.258307 4952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.250062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:53921 (local address 127.30.35.254:38787)
0807 20:17:46.250119 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:46.250122 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:46.250294 (+ 172us) server_negotiation.cc:407] Connection header received
0807 20:17:46.250759 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:46.250760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:46.250770 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:46.250822 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:46.251666 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.252161 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.253104 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.253392 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.253454 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.255675 (+ 2221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:46.255677 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:46.255677 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:46.255684 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:46.256936 (+ 1252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:46.257352 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:46.257354 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:46.257354 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:46.257424 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:46.257712 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:46.257712 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:46.257713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:46.257820 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:46.257871 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:46.258168 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 20:17:46.258243 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 20:17:46.258539 5401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.250026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:38787 (local address 127.30.35.194:53921)
0807 20:17:46.250179 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:46.250219 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:46.250687 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:46.250877 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:46.250880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:46.251125 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:46.251602 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.251608 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.252222 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.252223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.253008 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.253010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.253484 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.253485 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.253621 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.254101 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:46.254109 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:46.255590 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:46.257012 (+ 1422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:46.257020 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:46.257022 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:46.257287 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:46.257485 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:46.257486 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:46.257486 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:46.257615 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:46.257874 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:46.257880 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:46.258043 (+ 163us) client_negotiation.cc:769] Sending connection context
0807 20:17:46.258148 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 20:17:46.258302 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260807 20:17:46.259056 5399 heartbeater.cc:347] Connected to a master server at 127.30.35.254:38787
I20260807 20:17:46.259147 5399 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:46.259291 5399 heartbeater.cc:511] Master 127.30.35.254:38787 requested a full tablet report, sending...
I20260807 20:17:46.259660 4882 ts_manager.cc:194] Registered new tserver with Master: fc9dd2f174d14c1983dc3791c3474f56 (127.30.35.194:41307)
I20260807 20:17:46.259992 4882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:53921
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:17:46.280277 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:38787
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:36273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:46.363101 5406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:46.363354 5406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:46.363392 5406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:46.364562 5406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:46.364611 5406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:46.364650 5406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:17:46.366195 5406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:38787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:46.366451 5406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:46.366669 5406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 20:17:46.371774 5406 server_base.cc:1034] running on GCE node
W20260807 20:17:46.371743 5414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:46.371723 5413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:46.371771 5417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:46.372184 5406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:46.372397 5406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:46.373545 5406 hybrid_clock.cc:648] HybridClock initialized: now 1786133866373532 us; error 30 us; skew 500 ppm
Aug 07 20:17:46 dist-test-slave-t7g5 krb5kdc[4809](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133866, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:46.376055 5406 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:17:46.376394 5406 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:46.376456 5406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:46.376586 5406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:46.377622 5406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "43234ab6ea37430bb5396574553085d0"
format_stamp: "Formatted at 2026-08-07 20:17:46 on dist-test-slave-t7g5"
server_key: "0526e89402417e468ce1030cc87108a8"
server_key_iv: "f53029504c71c2207bf4f7a2a951c9e0"
server_key_version: "encryptionkey@0"
I20260807 20:17:46.378006 5406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "43234ab6ea37430bb5396574553085d0"
format_stamp: "Formatted at 2026-08-07 20:17:46 on dist-test-slave-t7g5"
server_key: "0526e89402417e468ce1030cc87108a8"
server_key_iv: "f53029504c71c2207bf4f7a2a951c9e0"
server_key_version: "encryptionkey@0"
I20260807 20:17:46.379225 5406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:17:46.379948 5428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:46.380086 5406 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:17:46.380172 5406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "43234ab6ea37430bb5396574553085d0"
format_stamp: "Formatted at 2026-08-07 20:17:46 on dist-test-slave-t7g5"
server_key: "0526e89402417e468ce1030cc87108a8"
server_key_iv: "f53029504c71c2207bf4f7a2a951c9e0"
server_key_version: "encryptionkey@0"
I20260807 20:17:46.380231 5406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:46.399648 5406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:46.401844 5406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:46.401989 5406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:46.402216 5406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:46.402534 5406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:46.402567 5406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:46.402596 5406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:46.402614 5406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:46.408043 5406 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:37105
I20260807 20:17:46.408090 5634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:37105 every 8 connection(s)
I20260807 20:17:46.408337 5406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
Aug 07 20:17:46 dist-test-slave-t7g5 krb5kdc[4809](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133866, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:46.415517 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 5406
I20260807 20:17:46.415611 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:17:46.415787 30863 external_mini_cluster.cc:1428] Setting key 2f0cc2be286b546ca6cb2926e25b2282
I20260807 20:17:46.417063 4952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.409104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:48997 (local address 127.30.35.254:38787)
0807 20:17:46.409156 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:46.409157 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:46.409252 (+ 95us) server_negotiation.cc:407] Connection header received
0807 20:17:46.409825 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:46.409826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:46.409837 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:46.409880 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:46.410755 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.411250 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.412163 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.412336 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.412378 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.414407 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:46.414409 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:46.414409 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:46.414416 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:46.415550 (+ 1134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:46.416211 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:46.416212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:46.416212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:46.416275 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:46.416527 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:46.416528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:46.416528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:46.416658 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:46.416713 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:46.416935 (+ 222us) server_negotiation.cc:299] Negotiation successful
0807 20:17:46.417000 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 20:17:46.417244 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.408992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:38787 (local address 127.30.35.195:48997)
0807 20:17:46.409149 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:46.409192 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:46.409717 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:46.409938 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:46.409941 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:46.410187 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:46.410658 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.410663 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.411317 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.411318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.412105 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.412107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.412388 (+ 281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.412389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.412489 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.412928 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:46.412937 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:46.414317 (+ 1380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:46.415797 (+ 1480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:46.415803 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:46.415804 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:46.416110 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:46.416358 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:46.416358 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:46.416359 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:46.416461 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:46.416713 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:46.416718 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:46.416833 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 20:17:46.416927 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 20:17:46.417051 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":68,"threads_started":1}
I20260807 20:17:46.417635 5638 heartbeater.cc:347] Connected to a master server at 127.30.35.254:38787
I20260807 20:17:46.417763 5638 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:46.417905 5638 heartbeater.cc:511] Master 127.30.35.254:38787 requested a full tablet report, sending...
I20260807 20:17:46.418244 4882 ts_manager.cc:194] Registered new tserver with Master: 43234ab6ea37430bb5396574553085d0 (127.30.35.195:37105)
I20260807 20:17:46.418603 4882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:48997
I20260807 20:17:46.427323 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:17:46.433732 4952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.428529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57828 (local address 127.30.35.254:38787)
0807 20:17:46.428592 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:46.428593 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:46.428674 (+ 81us) server_negotiation.cc:407] Connection header received
0807 20:17:46.428714 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:46.428715 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:46.428724 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:46.428767 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:46.429254 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.429796 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.430480 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.430679 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.430725 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.431739 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:46.431740 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:46.431740 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:46.431745 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:46.432834 (+ 1089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:46.433126 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:46.433126 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:46.433126 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:46.433170 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:46.433294 (+ 124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:46.433294 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:46.433295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:46.433423 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:46.433491 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:46.433567 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 20:17:46.433622 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 20:17:46.435119 4882 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57828:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:17:46.436623 4882 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:46.442898 5664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.438763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:41973 (local address 127.0.0.1:57294)
0807 20:17:46.439075 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:46.439121 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:46.439185 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:46.439637 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:46.439638 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:46.439640 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:46.439736 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.439738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.440637 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.440638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.441929 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.441932 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.442605 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.442606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.442685 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.442699 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 20:17:46.442764 (+ 65us) client_negotiation.cc:240] Negotiation successful
0807 20:17:46.442817 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"mutex_wait_us":1,"thread_start_us":80,"threads_started":1}
I20260807 20:17:46.442909 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.438902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57294 (local address 127.30.35.193:41973)
0807 20:17:46.439499 (+ 597us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:46.439503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:46.439512 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:46.439548 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:46.439550 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:46.439564 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:46.439640 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:46.439798 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.440551 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.442019 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.442529 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.442594 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.442655 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:46.442786 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 20:17:46.442831 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":72,"threads_started":1}
I20260807 20:17:46.443234 5658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.438753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:41307 (local address 127.0.0.1:54760)
0807 20:17:46.439075 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:46.439121 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:46.439188 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:46.439935 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:46.439936 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:46.439938 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:46.439969 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.439970 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.441040 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.441041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.441899 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.441902 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.443022 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.443023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.443082 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.443085 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:46.443134 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 20:17:46.443172 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":62,"threads_started":1}
I20260807 20:17:46.443274 5660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.438864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54760 (local address 127.30.35.194:41307)
0807 20:17:46.439777 (+ 913us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:46.439783 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:46.439793 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:17:46.439832 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:46.439834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:46.439849 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:46.439925 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:46.440030 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.440949 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.441986 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.442704 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.442782 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.442870 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:46.443155 (+ 285us) server_negotiation.cc:299] Negotiation successful
0807 20:17:46.443195 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":876,"thread_start_us":95,"threads_started":1}
I20260807 20:17:46.443661 5085 tablet_service.cc:1467] Processing CreateTablet for tablet 68f14fa05dfa45fc9db51a5ba1da4226 (DEFAULT_TABLE table=test-table [id=5dc6ea3d16784d798376aebe6db79890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:46.443818 5280 tablet_service.cc:1467] Processing CreateTablet for tablet 68f14fa05dfa45fc9db51a5ba1da4226 (DEFAULT_TABLE table=test-table [id=5dc6ea3d16784d798376aebe6db79890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:46.444077 5085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68f14fa05dfa45fc9db51a5ba1da4226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:46.444172 5280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68f14fa05dfa45fc9db51a5ba1da4226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:46.445885 5657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.438961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:37105 (local address 127.0.0.1:59938)
0807 20:17:46.439075 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:46.439121 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:46.439185 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:46.439392 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:46.439394 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:46.439396 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:46.439466 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.439468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.440762 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.440762 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.441984 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.441986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.442878 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.442890 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.442959 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.442964 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:17:46.445772 (+ 2808us) client_negotiation.cc:240] Negotiation successful
0807 20:17:46.445820 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":3,"thread_start_us":67,"threads_started":1}
I20260807 20:17:46.446123 5672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.439057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59938 (local address 127.30.35.195:37105)
0807 20:17:46.439253 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:46.439258 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:46.439269 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:17:46.439305 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:46.439306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:46.439318 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:46.439377 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:46.439553 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.440661 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.442059 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.442721 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.442782 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.442838 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:46.445996 (+ 3158us) server_negotiation.cc:299] Negotiation successful
0807 20:17:46.446046 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":87,"threads_started":1}
I20260807 20:17:46.446777 5675 tablet_bootstrap.cc:492] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a: Bootstrap starting.
I20260807 20:17:46.447085 5676 tablet_bootstrap.cc:492] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56: Bootstrap starting.
I20260807 20:17:46.447464 5512 tablet_service.cc:1467] Processing CreateTablet for tablet 68f14fa05dfa45fc9db51a5ba1da4226 (DEFAULT_TABLE table=test-table [id=5dc6ea3d16784d798376aebe6db79890]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:46.447562 5675 tablet_bootstrap.cc:654] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:46.447656 5676 tablet_bootstrap.cc:654] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:46.447758 5512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68f14fa05dfa45fc9db51a5ba1da4226. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:46.448261 5675 log.cc:824] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:46.448261 5676 log.cc:824] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:46.449005 5675 tablet_bootstrap.cc:492] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a: No bootstrap required, opened a new log
I20260807 20:17:46.449077 5675 ts_tablet_manager.cc:1397] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:17:46.449278 5676 tablet_bootstrap.cc:492] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56: No bootstrap required, opened a new log
I20260807 20:17:46.449345 5676 ts_tablet_manager.cc:1397] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:46.451079 5675 raft_consensus.cc:348] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc9dd2f174d14c1983dc3791c3474f56" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41307 } } peers { permanent_uuid: "43234ab6ea37430bb5396574553085d0" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37105 } } peers { permanent_uuid: "128c274f64a2461c9b9f717776b61e6a" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 41973 } }
I20260807 20:17:46.451270 5675 raft_consensus.cc:374] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:46.451315 5675 raft_consensus.cc:729] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 128c274f64a2461c9b9f717776b61e6a, State: Initialized, Role: FOLLOWER
I20260807 20:17:46.451232 5676 raft_consensus.cc:348] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc9dd2f174d14c1983dc3791c3474f56" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41307 } } peers { permanent_uuid: "43234ab6ea37430bb5396574553085d0" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37105 } } peers { permanent_uuid: "128c274f64a2461c9b9f717776b61e6a" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 41973 } }
I20260807 20:17:46.451388 5676 raft_consensus.cc:374] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:46.451431 5676 raft_consensus.cc:729] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc9dd2f174d14c1983dc3791c3474f56, State: Initialized, Role: FOLLOWER
I20260807 20:17:46.451448 5675 consensus_queue.cc:260] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc9dd2f174d14c1983dc3791c3474f56" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41307 } } peers { permanent_uuid: "43234ab6ea37430bb5396574553085d0" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37105 } } peers { permanent_uuid: "128c274f64a2461c9b9f717776b61e6a" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 41973 } }
I20260807 20:17:46.451530 5676 consensus_queue.cc:260] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc9dd2f174d14c1983dc3791c3474f56" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41307 } } peers { permanent_uuid: "43234ab6ea37430bb5396574553085d0" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37105 } } peers { permanent_uuid: "128c274f64a2461c9b9f717776b61e6a" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 41973 } }
I20260807 20:17:46.451742 5675 ts_tablet_manager.cc:1428] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:17:46.451754 5176 heartbeater.cc:503] Master 127.30.35.254:38787 was elected leader, sending a full tablet report...
I20260807 20:17:46.451804 5399 heartbeater.cc:503] Master 127.30.35.254:38787 was elected leader, sending a full tablet report...
I20260807 20:17:46.451953 5680 tablet_bootstrap.cc:492] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0: Bootstrap starting.
I20260807 20:17:46.452168 5676 ts_tablet_manager.cc:1428] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:17:46.452853 5680 tablet_bootstrap.cc:654] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:46.453368 5680 log.cc:824] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:46.454068 5680 tablet_bootstrap.cc:492] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0: No bootstrap required, opened a new log
I20260807 20:17:46.454123 5680 ts_tablet_manager.cc:1397] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:46.455533 5680 raft_consensus.cc:348] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc9dd2f174d14c1983dc3791c3474f56" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41307 } } peers { permanent_uuid: "43234ab6ea37430bb5396574553085d0" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37105 } } peers { permanent_uuid: "128c274f64a2461c9b9f717776b61e6a" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 41973 } }
I20260807 20:17:46.455665 5680 raft_consensus.cc:374] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:46.455687 5680 raft_consensus.cc:729] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43234ab6ea37430bb5396574553085d0, State: Initialized, Role: FOLLOWER
I20260807 20:17:46.455798 5680 consensus_queue.cc:260] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc9dd2f174d14c1983dc3791c3474f56" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41307 } } peers { permanent_uuid: "43234ab6ea37430bb5396574553085d0" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37105 } } peers { permanent_uuid: "128c274f64a2461c9b9f717776b61e6a" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 41973 } }
I20260807 20:17:46.456032 5680 ts_tablet_manager.cc:1428] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:17:46.456058 5638 heartbeater.cc:503] Master 127.30.35.254:38787 was elected leader, sending a full tablet report...
W20260807 20:17:46.499925 5400 tablet.cc:2369] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:17:46.601785 5177 tablet.cc:2369] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:17:46.658835 5639 tablet.cc:2369] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:17:46.785817 5685 raft_consensus.cc:482] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:46.785957 5685 raft_consensus.cc:504] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc9dd2f174d14c1983dc3791c3474f56" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41307 } } peers { permanent_uuid: "43234ab6ea37430bb5396574553085d0" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37105 } } peers { permanent_uuid: "128c274f64a2461c9b9f717776b61e6a" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 41973 } }
I20260807 20:17:46.786284 5685 leader_election.cc:288] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc9dd2f174d14c1983dc3791c3474f56 (127.30.35.194:41307), 128c274f64a2461c9b9f717776b61e6a (127.30.35.193:41973)
I20260807 20:17:46.789871 5660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.786550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:58245 (local address 127.30.35.194:41307)
0807 20:17:46.786596 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:46.786598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:46.786770 (+ 172us) server_negotiation.cc:407] Connection header received
0807 20:17:46.786801 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:46.786802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:46.786811 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:46.786856 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:46.787008 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.787679 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.789050 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.789523 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.789582 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.789590 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:46.789762 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 20:17:46.789800 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:17:46.789870 5688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.786501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:41307 (local address 127.30.35.195:58245)
0807 20:17:46.786699 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:46.786707 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:46.786759 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:46.786876 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:46.786877 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:46.786888 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:46.786945 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.786946 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.787745 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.787746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.788974 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.788978 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.789603 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.789605 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.789702 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.789707 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:17:46.789747 (+ 40us) client_negotiation.cc:240] Negotiation successful
0807 20:17:46.789781 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":15,"thread_start_us":102,"threads_started":1}
I20260807 20:17:46.789939 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.786598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:46747 (local address 127.30.35.193:41973)
0807 20:17:46.786644 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:46.786646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:46.786654 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:46.786683 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:46.786684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:46.786692 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:46.786742 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:46.786897 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.787633 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.789101 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.789568 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.789641 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.789675 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:46.789845 (+ 170us) server_negotiation.cc:299] Negotiation successful
0807 20:17:46.789881 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 20:17:46.789973 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.786499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:41973 (local address 127.30.35.195:46747)
0807 20:17:46.786565 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:46.786579 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:46.786632 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:46.786759 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:46.786760 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:46.786762 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:46.786832 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.786834 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.787706 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.787706 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.788979 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:46.788980 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.789671 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.789673 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:46.789765 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.789769 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:46.789823 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 20:17:46.789863 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":53}
I20260807 20:17:46.790314 5317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68f14fa05dfa45fc9db51a5ba1da4226" candidate_uuid: "43234ab6ea37430bb5396574553085d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9dd2f174d14c1983dc3791c3474f56" is_pre_election: true
I20260807 20:17:46.790488 5317 raft_consensus.cc:2454] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43234ab6ea37430bb5396574553085d0 in term 0.
I20260807 20:17:46.790721 5430 leader_election.cc:302] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43234ab6ea37430bb5396574553085d0, fc9dd2f174d14c1983dc3791c3474f56; no voters:
I20260807 20:17:46.790691 5115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68f14fa05dfa45fc9db51a5ba1da4226" candidate_uuid: "43234ab6ea37430bb5396574553085d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "128c274f64a2461c9b9f717776b61e6a" is_pre_election: true
I20260807 20:17:46.790839 5115 raft_consensus.cc:2454] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43234ab6ea37430bb5396574553085d0 in term 0.
I20260807 20:17:46.790853 5685 raft_consensus.cc:2781] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:46.790913 5685 raft_consensus.cc:482] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:46.790946 5685 raft_consensus.cc:3037] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:46.791626 5685 raft_consensus.cc:504] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc9dd2f174d14c1983dc3791c3474f56" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41307 } } peers { permanent_uuid: "43234ab6ea37430bb5396574553085d0" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37105 } } peers { permanent_uuid: "128c274f64a2461c9b9f717776b61e6a" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 41973 } }
I20260807 20:17:46.791747 5685 leader_election.cc:288] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [CANDIDATE]: Term 1 election: Requested vote from peers fc9dd2f174d14c1983dc3791c3474f56 (127.30.35.194:41307), 128c274f64a2461c9b9f717776b61e6a (127.30.35.193:41973)
I20260807 20:17:46.791937 5115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68f14fa05dfa45fc9db51a5ba1da4226" candidate_uuid: "43234ab6ea37430bb5396574553085d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "128c274f64a2461c9b9f717776b61e6a"
I20260807 20:17:46.791924 5317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68f14fa05dfa45fc9db51a5ba1da4226" candidate_uuid: "43234ab6ea37430bb5396574553085d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc9dd2f174d14c1983dc3791c3474f56"
I20260807 20:17:46.792006 5317 raft_consensus.cc:3037] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:46.792006 5115 raft_consensus.cc:3037] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:46.792815 5317 raft_consensus.cc:2454] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43234ab6ea37430bb5396574553085d0 in term 1.
I20260807 20:17:46.792815 5115 raft_consensus.cc:2454] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43234ab6ea37430bb5396574553085d0 in term 1.
I20260807 20:17:46.792968 5430 leader_election.cc:302] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43234ab6ea37430bb5396574553085d0, fc9dd2f174d14c1983dc3791c3474f56; no voters:
I20260807 20:17:46.793085 5685 raft_consensus.cc:2781] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:46.793248 5685 raft_consensus.cc:686] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [term 1 LEADER]: Becoming Leader. State: Replica: 43234ab6ea37430bb5396574553085d0, State: Running, Role: LEADER
I20260807 20:17:46.793337 5685 consensus_queue.cc:237] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc9dd2f174d14c1983dc3791c3474f56" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41307 } } peers { permanent_uuid: "43234ab6ea37430bb5396574553085d0" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37105 } } peers { permanent_uuid: "128c274f64a2461c9b9f717776b61e6a" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 41973 } }
I20260807 20:17:46.794194 4882 catalog_manager.cc:5495] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43234ab6ea37430bb5396574553085d0 (127.30.35.195). New cstate: current_term: 1 leader_uuid: "43234ab6ea37430bb5396574553085d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc9dd2f174d14c1983dc3791c3474f56" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43234ab6ea37430bb5396574553085d0" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "128c274f64a2461c9b9f717776b61e6a" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 41973 } health_report { overall_health: UNKNOWN } } }
I20260807 20:17:46.880368 5672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.878257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59952 (local address 127.30.35.195:37105)
0807 20:17:46.878320 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:46.878322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:46.878331 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:46.878368 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:46.878369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:46.878397 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:46.878457 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:46.878584 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.879051 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.879719 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:46.879911 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:46.879967 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:46.880079 (+ 112us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:46.880181 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:46.880240 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:46.880253 (+ 13us) server_negotiation.cc:299] Negotiation successful
0807 20:17:46.880270 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 20:17:46.882112 5317 raft_consensus.cc:1261] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56 [term 1 FOLLOWER]: Refusing update from remote peer 43234ab6ea37430bb5396574553085d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:46.882124 5115 raft_consensus.cc:1261] T 68f14fa05dfa45fc9db51a5ba1da4226 P 128c274f64a2461c9b9f717776b61e6a [term 1 FOLLOWER]: Refusing update from remote peer 43234ab6ea37430bb5396574553085d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:46.882412 5685 consensus_queue.cc:1035] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc9dd2f174d14c1983dc3791c3474f56" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:46.882591 5689 consensus_queue.cc:1035] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "128c274f64a2461c9b9f717776b61e6a" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 41973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:46.885078 5695 mvcc.cc:205] Tried to move back new op lower bound from 7316004318746488832 to 7316004318386077696. Current Snapshot: MvccSnapshot[applied={T|T < 7316004318746488832}]
I20260807 20:17:46.886921 4881 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:46.887007 4881 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57828:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:46.887722 4881 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 32dff371dc0d4a979d97e3c56bc52d30: Sending DeleteTablet for 3 replicas of tablet 68f14fa05dfa45fc9db51a5ba1da4226
I20260807 20:17:46.888090 5280 tablet_service.cc:1514] Processing DeleteTablet for tablet 68f14fa05dfa45fc9db51a5ba1da4226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:46 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:54760
I20260807 20:17:46.888121 5085 tablet_service.cc:1514] Processing DeleteTablet for tablet 68f14fa05dfa45fc9db51a5ba1da4226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:46 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:57294
I20260807 20:17:46.888314 5710 tablet_replica.cc:330] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56: stopping tablet replica
I20260807 20:17:46.888417 5710 raft_consensus.cc:2229] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:46.888463 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 4979
I20260807 20:17:46.888473 5512 tablet_service.cc:1514] Processing DeleteTablet for tablet 68f14fa05dfa45fc9db51a5ba1da4226 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:46 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:59938
I20260807 20:17:46.888556 5710 raft_consensus.cc:2258] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:46.898495 5714 tablet_replica.cc:330] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0: stopping tablet replica
I20260807 20:17:46.898849 5710 ts_tablet_manager.cc:1905] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:46.900110 5714 raft_consensus.cc:2229] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:17:46.900236 5714 raft_consensus.cc:2258] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:46.900364 5710 ts_tablet_manager.cc:1918] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:46.900522 5710 log.cc:1196] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/68f14fa05dfa45fc9db51a5ba1da4226
I20260807 20:17:46.900717 5714 ts_tablet_manager.cc:1905] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:46.900857 5710 ts_tablet_manager.cc:1939] T 68f14fa05dfa45fc9db51a5ba1da4226 P fc9dd2f174d14c1983dc3791c3474f56: Deleting consensus metadata
I20260807 20:17:46.901358 4858 catalog_manager.cc:4841] TS fc9dd2f174d14c1983dc3791c3474f56 (127.30.35.194:41307): tablet 68f14fa05dfa45fc9db51a5ba1da4226 (table test-table [id=5dc6ea3d16784d798376aebe6db79890]) successfully deleted
I20260807 20:17:46.902384 5714 ts_tablet_manager.cc:1918] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:46.902468 5714 log.cc:1196] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/68f14fa05dfa45fc9db51a5ba1da4226
I20260807 20:17:46.902689 5714 ts_tablet_manager.cc:1939] T 68f14fa05dfa45fc9db51a5ba1da4226 P 43234ab6ea37430bb5396574553085d0: Deleting consensus metadata
I20260807 20:17:46.903110 4858 catalog_manager.cc:4841] TS 43234ab6ea37430bb5396574553085d0 (127.30.35.195:37105): tablet 68f14fa05dfa45fc9db51a5ba1da4226 (table test-table [id=5dc6ea3d16784d798376aebe6db79890]) successfully deleted
W20260807 20:17:46.905045 4860 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:41973 (error 108)
I20260807 20:17:46.905171 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 5185
I20260807 20:17:46.911722 5657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:46.911597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:41973 (local address 127.0.0.1:57302)
0807 20:17:46.911649 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:46.911682 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:41973: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260807 20:17:46.911840 4860 catalog_manager.cc:4584] TS 128c274f64a2461c9b9f717776b61e6a (127.30.35.193:41973): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 68f14fa05dfa45fc9db51a5ba1da4226: Network error: Client connection negotiation failed: client connection to 127.30.35.193:41973: connect: Connection refused (error 111)
I20260807 20:17:46.927768 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 5406
I20260807 20:17:46.941541 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 4829
2026-08-07T20:17:46Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2473 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T20:17:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:46Z Disabled control of system clock
I20260807 20:17:46.974480 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:43053
--webserver_interface=127.30.35.254
--webserver_port=0
--builtin_ntp_servers=127.30.35.212:36005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:43053
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 20:17:47.055197 5719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:47.055410 5719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:47.055429 5719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:47.056514 5719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:47.056550 5719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:47.056560 5719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:47.056571 5719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:47.056586 5719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:47.057893 5719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:43053
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:43053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:47.058096 5719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:47.058331 5719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:47.062801 5738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:47.062808 5735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:47.062844 5733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:47.063089 5719 server_base.cc:1034] running on GCE node
I20260807 20:17:47.063339 5719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:47.063601 5719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:47.064742 5719 hybrid_clock.cc:648] HybridClock initialized: now 1786133867064729 us; error 29 us; skew 500 ppm
I20260807 20:17:47.066037 5719 webserver.cc:460] Webserver started at http://127.30.35.254:34349/ using document root <none> and password file <none>
I20260807 20:17:47.066270 5719 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:47.066316 5719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:47.066447 5719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:47.067512 5719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "5d575632dd584fe38cba0dd4e7d2f58e"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "671ec02fc0971da86d980d6005f52ff6"
server_key_iv: "5ef3dc6c4a4bb1d551a03e94eafe0d3f"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.067838 5719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "5d575632dd584fe38cba0dd4e7d2f58e"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "671ec02fc0971da86d980d6005f52ff6"
server_key_iv: "5ef3dc6c4a4bb1d551a03e94eafe0d3f"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.069048 5719 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:17:47.069700 5754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:47.069844 5719 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:47.069943 5719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "5d575632dd584fe38cba0dd4e7d2f58e"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "671ec02fc0971da86d980d6005f52ff6"
server_key_iv: "5ef3dc6c4a4bb1d551a03e94eafe0d3f"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.070011 5719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:47.073165 5719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:47.073402 5719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:47.073518 5719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:47.077080 5719 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:43053
I20260807 20:17:47.077127 5853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:43053 every 8 connection(s)
I20260807 20:17:47.077407 5719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:47.078044 5855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:47.078293 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 5719
I20260807 20:17:47.078372 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:47.078522 30863 external_mini_cluster.cc:1428] Setting key 4d34ea05eabd378247b2274a2fdf05dc
I20260807 20:17:47.080842 5859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.079040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50708 (local address 127.30.35.254:43053)
0807 20:17:47.079239 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.079248 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.079280 (+ 32us) server_negotiation.cc:407] Connection header received
0807 20:17:47.079659 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.079667 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.079720 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.079863 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:47.080435 (+ 572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:47.080439 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:47.080439 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:47.080444 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:47.080490 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:47.080503 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:47.080574 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:47.080610 (+ 36us) server_negotiation.cc:299] Negotiation successful
0807 20:17:47.080663 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":83,"threads_started":1}
I20260807 20:17:47.081624 5855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e: Bootstrap starting.
I20260807 20:17:47.082201 5855 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:47.082466 5855 log.cc:824] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:47.083060 5855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e: No bootstrap required, opened a new log
I20260807 20:17:47.084390 5855 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d575632dd584fe38cba0dd4e7d2f58e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43053 } }
I20260807 20:17:47.084528 5855 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:47.084553 5855 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d575632dd584fe38cba0dd4e7d2f58e, State: Initialized, Role: FOLLOWER
I20260807 20:17:47.084666 5855 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d575632dd584fe38cba0dd4e7d2f58e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43053 } }
I20260807 20:17:47.084733 5855 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:47.084765 5855 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:47.084810 5855 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:47.085287 5855 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d575632dd584fe38cba0dd4e7d2f58e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43053 } }
I20260807 20:17:47.085376 5855 leader_election.cc:302] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d575632dd584fe38cba0dd4e7d2f58e; no voters:
I20260807 20:17:47.085536 5855 leader_election.cc:288] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:47.085814 5855 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:47.085840 5861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:47.085963 5861 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [term 1 LEADER]: Becoming Leader. State: Replica: 5d575632dd584fe38cba0dd4e7d2f58e, State: Running, Role: LEADER
I20260807 20:17:47.086090 5861 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d575632dd584fe38cba0dd4e7d2f58e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43053 } }
I20260807 20:17:47.086447 5864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d575632dd584fe38cba0dd4e7d2f58e. Latest consensus state: current_term: 1 leader_uuid: "5d575632dd584fe38cba0dd4e7d2f58e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d575632dd584fe38cba0dd4e7d2f58e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43053 } } }
I20260807 20:17:47.086544 5864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:47.086735 5877 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:47.087107 5862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d575632dd584fe38cba0dd4e7d2f58e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d575632dd584fe38cba0dd4e7d2f58e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43053 } } }
I20260807 20:17:47.087184 5862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:47.087327 5877 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:47.088761 5877 catalog_manager.cc:1347] Generated new cluster ID: ed1db8331f934d46832c3b474a21e19b
I20260807 20:17:47.088816 5877 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:17:47.106673 5877 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:47.106858 5877 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:47.110961 5877 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e: Generated new TSK 0
I20260807 20:17:47.111142 5877 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:17:47.115871 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:43053
--builtin_ntp_servers=127.30.35.212:36005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 20:17:47.196996 5896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:47.197202 5896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:47.197227 5896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:47.198427 5896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:47.198468 5896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:47.198493 5896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:17:47.199807 5896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:43053
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:47.200040 5896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:47.200323 5896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:47.206068 5903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:47.206254 5896 server_base.cc:1034] running on GCE node
W20260807 20:17:47.206063 5907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:47.206424 5909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:47.206619 5896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:47.206847 5896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:47.207995 5896 hybrid_clock.cc:648] HybridClock initialized: now 1786133867207982 us; error 29 us; skew 500 ppm
I20260807 20:17:47.209160 5896 webserver.cc:460] Webserver started at http://127.30.35.193:39957/ using document root <none> and password file <none>
I20260807 20:17:47.209395 5896 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:47.209445 5896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:47.209574 5896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:47.210637 5896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "01a261b254ef44e7adcbafde664b8c57"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "e2fcd758bc7726c57b75d995aebe6254"
server_key_iv: "183d37e0fed3d747b7e9859df483e106"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.211043 5896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "01a261b254ef44e7adcbafde664b8c57"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "e2fcd758bc7726c57b75d995aebe6254"
server_key_iv: "183d37e0fed3d747b7e9859df483e106"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.212285 5896 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 20:17:47.212929 5916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:47.213095 5896 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:47.213177 5896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "01a261b254ef44e7adcbafde664b8c57"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "e2fcd758bc7726c57b75d995aebe6254"
server_key_iv: "183d37e0fed3d747b7e9859df483e106"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.213244 5896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:47.216454 5896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:47.216691 5896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:47.216809 5896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:47.217000 5896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:47.217283 5896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:47.217316 5896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:47.217342 5896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:47.217366 5896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:47.222934 5896 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:40695
I20260807 20:17:47.222973 6148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:40695 every 8 connection(s)
I20260807 20:17:47.223294 5896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:17:47.226037 5859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.223988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:42649 (local address 127.30.35.254:43053)
0807 20:17:47.224035 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.224037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.224273 (+ 236us) server_negotiation.cc:407] Connection header received
0807 20:17:47.224712 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.224713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.224719 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.224768 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:47.225853 (+ 1085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:47.225854 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:47.225855 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:47.225859 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:47.225873 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:47.225877 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:47.225925 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:47.225976 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 20:17:47.225986 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 20:17:47.226224 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.223974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43053 (local address 127.30.35.193:42649)
0807 20:17:47.224161 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:47.224195 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:47.224636 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:47.224823 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:47.224826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:47.224834 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:47.225718 (+ 884us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:17:47.225719 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:47.225753 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:17:47.225782 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:47.225927 (+ 145us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:47.225929 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:47.225932 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:47.225983 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 20:17:47.226032 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":88,"threads_started":1}
I20260807 20:17:47.226656 6150 heartbeater.cc:347] Connected to a master server at 127.30.35.254:43053
I20260807 20:17:47.226742 6150 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:47.226902 6150 heartbeater.cc:511] Master 127.30.35.254:43053 requested a full tablet report, sending...
I20260807 20:17:47.227372 5783 ts_manager.cc:194] Registered new tserver with Master: 01a261b254ef44e7adcbafde664b8c57 (127.30.35.193:40695)
I20260807 20:17:47.231149 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 5896
I20260807 20:17:47.231268 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:17:47.231487 30863 external_mini_cluster.cc:1428] Setting key c8d6fd72965d0cef515ff3bf8494487e
I20260807 20:17:47.232306 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:43053
--builtin_ntp_servers=127.30.35.212:36005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 20:17:47.313402 6154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:47.313616 6154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:47.313638 6154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:47.314795 6154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:47.314839 6154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:47.314863 6154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:17:47.316313 6154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:43053
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:47.316534 6154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:47.316838 6154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:47.321883 6167 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:47.321879 6162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:47.321892 6163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:47.322072 6154 server_base.cc:1034] running on GCE node
I20260807 20:17:47.322415 6154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:47.322633 6154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:47.323757 6154 hybrid_clock.cc:648] HybridClock initialized: now 1786133867323749 us; error 28 us; skew 500 ppm
I20260807 20:17:47.325022 6154 webserver.cc:460] Webserver started at http://127.30.35.194:33205/ using document root <none> and password file <none>
I20260807 20:17:47.325261 6154 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:47.325309 6154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:47.325443 6154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:47.326555 6154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "13afb4ac487344d8a9715b969fb41ef0"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "17722ff27c2b4339ea71b606d2ef90b5"
server_key_iv: "7926f18eda78407040cd28fe772218a1"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.326885 6154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "13afb4ac487344d8a9715b969fb41ef0"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "17722ff27c2b4339ea71b606d2ef90b5"
server_key_iv: "7926f18eda78407040cd28fe772218a1"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.328099 6154 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 20:17:47.328791 6176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:47.328943 6154 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:17:47.329025 6154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "13afb4ac487344d8a9715b969fb41ef0"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "17722ff27c2b4339ea71b606d2ef90b5"
server_key_iv: "7926f18eda78407040cd28fe772218a1"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.329088 6154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:47.332356 6154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:47.332597 6154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:47.332710 6154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:47.332890 6154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:47.333180 6154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:47.333212 6154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:47.333241 6154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:47.333264 6154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:47.338706 6154 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:37891
I20260807 20:17:47.338759 6371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:37891 every 8 connection(s)
I20260807 20:17:47.339056 6154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:17:47.341846 5859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.339704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:41383 (local address 127.30.35.254:43053)
0807 20:17:47.339745 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.339747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.339981 (+ 234us) server_negotiation.cc:407] Connection header received
0807 20:17:47.340445 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.340446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.340453 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.340507 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:47.341584 (+ 1077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:47.341585 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:47.341586 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:47.341590 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:47.341607 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:47.341611 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:47.341694 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:47.341761 (+ 67us) server_negotiation.cc:299] Negotiation successful
0807 20:17:47.341775 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 20:17:47.342021 6377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.339692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43053 (local address 127.30.35.194:41383)
0807 20:17:47.339869 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:47.339900 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:47.340349 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:47.340586 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:47.340590 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:47.340600 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:47.341443 (+ 843us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:17:47.341443 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:47.341471 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:17:47.341499 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:47.341684 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:47.341690 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:47.341693 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:47.341767 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 20:17:47.341828 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":84,"threads_started":1}
I20260807 20:17:47.342408 6374 heartbeater.cc:347] Connected to a master server at 127.30.35.254:43053
I20260807 20:17:47.342499 6374 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:47.342631 6374 heartbeater.cc:511] Master 127.30.35.254:43053 requested a full tablet report, sending...
I20260807 20:17:47.342947 5783 ts_manager.cc:194] Registered new tserver with Master: 13afb4ac487344d8a9715b969fb41ef0 (127.30.35.194:37891)
I20260807 20:17:47.347394 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 6154
I20260807 20:17:47.347476 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:17:47.347618 30863 external_mini_cluster.cc:1428] Setting key 3d5805d856016913c05b9c2cf8c5ba9f
I20260807 20:17:47.348438 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:43053
--builtin_ntp_servers=127.30.35.212:36005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 20:17:47.430491 6378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:47.430688 6378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:47.430708 6378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:47.431838 6378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:47.431876 6378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:47.431903 6378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:17:47.433306 6378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:43053
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:47.433511 6378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:47.433785 6378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:47.438408 6389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:47.438421 6391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:47.438423 6388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:47.438541 6378 server_base.cc:1034] running on GCE node
I20260807 20:17:47.438890 6378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:47.439085 6378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:47.440209 6378 hybrid_clock.cc:648] HybridClock initialized: now 1786133867440200 us; error 26 us; skew 500 ppm
I20260807 20:17:47.441349 6378 webserver.cc:460] Webserver started at http://127.30.35.195:45845/ using document root <none> and password file <none>
I20260807 20:17:47.441584 6378 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:47.441635 6378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:47.441802 6378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:47.442842 6378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "285251e581eb476ca0ca06da1775a2a6"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "f85951a05db5bdbaa606b243b0561c0c"
server_key_iv: "939fe8830e540aea41f0e5a02b312658"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.443176 6378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "285251e581eb476ca0ca06da1775a2a6"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "f85951a05db5bdbaa606b243b0561c0c"
server_key_iv: "939fe8830e540aea41f0e5a02b312658"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.444352 6378 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:47.445127 6405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:47.445297 6378 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:47.445375 6378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "285251e581eb476ca0ca06da1775a2a6"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "f85951a05db5bdbaa606b243b0561c0c"
server_key_iv: "939fe8830e540aea41f0e5a02b312658"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.445430 6378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:47.448582 6378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:47.448782 6378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:47.448869 6378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:47.449023 6378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:47.449263 6378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:47.449292 6378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:47.449311 6378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:47.449327 6378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:47.454574 6378 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:39295
I20260807 20:17:47.454636 6600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:39295 every 8 connection(s)
I20260807 20:17:47.454917 6378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:17:47.457511 5859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.455603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:60989 (local address 127.30.35.254:43053)
0807 20:17:47.455659 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.455660 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.455868 (+ 208us) server_negotiation.cc:407] Connection header received
0807 20:17:47.456281 (+ 413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.456282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.456287 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.456341 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:47.457322 (+ 981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:47.457323 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:47.457323 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:47.457327 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:47.457342 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:47.457345 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:47.457390 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:47.457446 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 20:17:47.457458 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 20:17:47.457695 6604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.455567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43053 (local address 127.30.35.195:60989)
0807 20:17:47.455756 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:47.455795 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:47.456206 (+ 411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:47.456398 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:47.456402 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:47.456409 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:47.457195 (+ 786us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:17:47.457195 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:47.457222 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:17:47.457249 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:47.457388 (+ 139us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:47.457390 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:47.457392 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 20:17:47.457448 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 20:17:47.457492 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":86,"threads_started":1}
I20260807 20:17:47.458123 6602 heartbeater.cc:347] Connected to a master server at 127.30.35.254:43053
I20260807 20:17:47.458204 6602 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:47.458348 6602 heartbeater.cc:511] Master 127.30.35.254:43053 requested a full tablet report, sending...
I20260807 20:17:47.458721 5783 ts_manager.cc:194] Registered new tserver with Master: 285251e581eb476ca0ca06da1775a2a6 (127.30.35.195:39295)
I20260807 20:17:47.463773 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 6378
I20260807 20:17:47.463851 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:17:47.463985 30863 external_mini_cluster.cc:1428] Setting key d2737b8a779f97908c2c98699a7c3626
I20260807 20:17:47.464773 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:17:47.467103 5859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.466036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50724 (local address 127.30.35.254:43053)
0807 20:17:47.466100 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.466102 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.466193 (+ 91us) server_negotiation.cc:407] Connection header received
0807 20:17:47.466267 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.466267 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.466274 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.466319 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:47.466872 (+ 553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:47.466873 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:47.466873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:47.466877 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:47.466891 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:47.466895 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:47.466964 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:47.467019 (+ 55us) server_negotiation.cc:299] Negotiation successful
0807 20:17:47.467033 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 20:17:47.468446 5783 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50724:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:17:47.470010 5783 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:47.473487 6615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.472023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:40695 (local address 127.0.0.1:47986)
0807 20:17:47.472349 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:47.472374 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:47.472431 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:47.472607 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:47.472612 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:47.472619 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:47.473055 (+ 436us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:17:47.473055 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:47.473072 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:17:47.473097 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:47.473318 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:47.473325 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:47.473327 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 20:17:47.473397 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 20:17:47.473410 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":91,"threads_started":1}
I20260807 20:17:47.473778 6618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.472135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47986 (local address 127.30.35.193:40695)
0807 20:17:47.472314 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.472319 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.472485 (+ 166us) server_negotiation.cc:407] Connection header received
0807 20:17:47.472517 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.472520 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.472532 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.472602 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:47.473160 (+ 558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:47.473168 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:47.473168 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:47.473172 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:47.473212 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:47.473235 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:47.473293 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:47.473679 (+ 386us) server_negotiation.cc:299] Negotiation successful
0807 20:17:47.473696 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":96,"threads_started":1}
I20260807 20:17:47.473923 6620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.472019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:37891 (local address 127.0.0.1:37278)
0807 20:17:47.472335 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:47.472374 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:47.472429 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:47.472726 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:47.472727 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:47.472729 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:47.473317 (+ 588us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:17:47.473317 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:47.473323 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:17:47.473334 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:47.473801 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:47.473802 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:47.473803 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 20:17:47.473847 (+ 44us) client_negotiation.cc:240] Negotiation successful
0807 20:17:47.473860 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":59,"threads_started":1}
I20260807 20:17:47.473963 6621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.472437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37278 (local address 127.30.35.194:37891)
0807 20:17:47.472576 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.472580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.472591 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:17:47.472613 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.472615 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.472625 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.473257 (+ 632us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:47.473622 (+ 365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:47.473626 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:47.473626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:47.473629 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:47.473696 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:47.473714 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:47.473801 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:47.473863 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 20:17:47.473878 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":76,"threads_started":1}
I20260807 20:17:47.474485 6617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.472220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:39295 (local address 127.0.0.1:56250)
0807 20:17:47.472684 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:47.472693 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:47.472870 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:47.473279 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:47.473280 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:47.473283 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:47.473758 (+ 475us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:17:47.473759 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:47.473765 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:17:47.473777 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:47.474368 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:47.474368 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:47.474369 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 20:17:47.474414 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:17:47.474427 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":66,"threads_started":1}
I20260807 20:17:47.474541 6622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.472454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56250 (local address 127.30.35.195:39295)
0807 20:17:47.472632 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.472636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.472846 (+ 210us) server_negotiation.cc:407] Connection header received
0807 20:17:47.472943 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.472947 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.472957 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.473019 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:47.474213 (+ 1194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:47.474220 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:47.474220 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:47.474224 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:47.474258 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:47.474280 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:47.474321 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:47.474447 (+ 126us) server_negotiation.cc:299] Negotiation successful
0807 20:17:47.474464 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":82,"threads_started":1}
I20260807 20:17:47.474473 6018 tablet_service.cc:1467] Processing CreateTablet for tablet 3cf9812626c141f9b72d31bc547c94b0 (DEFAULT_TABLE table=test-table [id=8aefcfbd480d4829870e8fb586913729]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:47.474668 6267 tablet_service.cc:1467] Processing CreateTablet for tablet 3cf9812626c141f9b72d31bc547c94b0 (DEFAULT_TABLE table=test-table [id=8aefcfbd480d4829870e8fb586913729]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:47.474846 6018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cf9812626c141f9b72d31bc547c94b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:47.475001 6267 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cf9812626c141f9b72d31bc547c94b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:47.477291 6625 tablet_bootstrap.cc:492] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0: Bootstrap starting.
I20260807 20:17:47.477478 6626 tablet_bootstrap.cc:492] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57: Bootstrap starting.
I20260807 20:17:47.477746 6487 tablet_service.cc:1467] Processing CreateTablet for tablet 3cf9812626c141f9b72d31bc547c94b0 (DEFAULT_TABLE table=test-table [id=8aefcfbd480d4829870e8fb586913729]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:47.477880 6625 tablet_bootstrap.cc:654] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:47.478055 6487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cf9812626c141f9b72d31bc547c94b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:47.478101 6625 log.cc:824] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:47.478123 6626 tablet_bootstrap.cc:654] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:47.478406 6626 log.cc:824] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:47.478744 6625 tablet_bootstrap.cc:492] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0: No bootstrap required, opened a new log
I20260807 20:17:47.478806 6625 ts_tablet_manager.cc:1397] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:47.479139 6626 tablet_bootstrap.cc:492] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57: No bootstrap required, opened a new log
I20260807 20:17:47.479195 6626 ts_tablet_manager.cc:1397] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:47.480557 6625 raft_consensus.cc:348] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a261b254ef44e7adcbafde664b8c57" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 40695 } } peers { permanent_uuid: "13afb4ac487344d8a9715b969fb41ef0" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37891 } } peers { permanent_uuid: "285251e581eb476ca0ca06da1775a2a6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39295 } }
I20260807 20:17:47.480674 6625 raft_consensus.cc:374] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:47.480692 6625 raft_consensus.cc:729] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13afb4ac487344d8a9715b969fb41ef0, State: Initialized, Role: FOLLOWER
I20260807 20:17:47.480782 6625 consensus_queue.cc:260] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a261b254ef44e7adcbafde664b8c57" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 40695 } } peers { permanent_uuid: "13afb4ac487344d8a9715b969fb41ef0" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37891 } } peers { permanent_uuid: "285251e581eb476ca0ca06da1775a2a6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39295 } }
I20260807 20:17:47.481012 6625 ts_tablet_manager.cc:1428] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:17:47.481020 6631 tablet_bootstrap.cc:492] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6: Bootstrap starting.
I20260807 20:17:47.481127 6374 heartbeater.cc:503] Master 127.30.35.254:43053 was elected leader, sending a full tablet report...
I20260807 20:17:47.481559 6631 tablet_bootstrap.cc:654] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:47.481738 6626 raft_consensus.cc:348] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a261b254ef44e7adcbafde664b8c57" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 40695 } } peers { permanent_uuid: "13afb4ac487344d8a9715b969fb41ef0" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37891 } } peers { permanent_uuid: "285251e581eb476ca0ca06da1775a2a6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39295 } }
I20260807 20:17:47.481848 6631 log.cc:824] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:47.481895 6626 raft_consensus.cc:374] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:47.481948 6626 raft_consensus.cc:729] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01a261b254ef44e7adcbafde664b8c57, State: Initialized, Role: FOLLOWER
I20260807 20:17:47.482061 6626 consensus_queue.cc:260] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a261b254ef44e7adcbafde664b8c57" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 40695 } } peers { permanent_uuid: "13afb4ac487344d8a9715b969fb41ef0" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37891 } } peers { permanent_uuid: "285251e581eb476ca0ca06da1775a2a6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39295 } }
I20260807 20:17:47.482390 6626 ts_tablet_manager.cc:1428] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:17:47.482448 6150 heartbeater.cc:503] Master 127.30.35.254:43053 was elected leader, sending a full tablet report...
I20260807 20:17:47.482646 6631 tablet_bootstrap.cc:492] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6: No bootstrap required, opened a new log
I20260807 20:17:47.482713 6631 ts_tablet_manager.cc:1397] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 20:17:47.484504 6631 raft_consensus.cc:348] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a261b254ef44e7adcbafde664b8c57" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 40695 } } peers { permanent_uuid: "13afb4ac487344d8a9715b969fb41ef0" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37891 } } peers { permanent_uuid: "285251e581eb476ca0ca06da1775a2a6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39295 } }
I20260807 20:17:47.484620 6631 raft_consensus.cc:374] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:47.484639 6631 raft_consensus.cc:729] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 285251e581eb476ca0ca06da1775a2a6, State: Initialized, Role: FOLLOWER
I20260807 20:17:47.484736 6631 consensus_queue.cc:260] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a261b254ef44e7adcbafde664b8c57" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 40695 } } peers { permanent_uuid: "13afb4ac487344d8a9715b969fb41ef0" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37891 } } peers { permanent_uuid: "285251e581eb476ca0ca06da1775a2a6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39295 } }
I20260807 20:17:47.484959 6631 ts_tablet_manager.cc:1428] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260807 20:17:47.484999 6602 heartbeater.cc:503] Master 127.30.35.254:43053 was elected leader, sending a full tablet report...
I20260807 20:17:47.509393 6634 raft_consensus.cc:482] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:47.509521 6634 raft_consensus.cc:504] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a261b254ef44e7adcbafde664b8c57" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 40695 } } peers { permanent_uuid: "13afb4ac487344d8a9715b969fb41ef0" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37891 } } peers { permanent_uuid: "285251e581eb476ca0ca06da1775a2a6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39295 } }
I20260807 20:17:47.509878 6634 leader_election.cc:288] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13afb4ac487344d8a9715b969fb41ef0 (127.30.35.194:37891), 285251e581eb476ca0ca06da1775a2a6 (127.30.35.195:39295)
I20260807 20:17:47.511193 6622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.510251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:52153 (local address 127.30.35.195:39295)
0807 20:17:47.510309 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.510311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.510425 (+ 114us) server_negotiation.cc:407] Connection header received
0807 20:17:47.510449 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.510449 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.510452 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.510492 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:47.510978 (+ 486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:47.510979 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:47.510980 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:47.510983 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:47.510997 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:47.511000 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:47.511055 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:47.511106 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 20:17:47.511119 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 20:17:47.511193 6621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.510154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:42423 (local address 127.30.35.194:37891)
0807 20:17:47.510273 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.510276 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.510283 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:17:47.510309 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.510310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.510316 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.510365 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:47.510969 (+ 604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:47.510970 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:47.510971 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:47.510975 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:47.510994 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:47.510999 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:47.511055 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:47.511106 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 20:17:47.511119 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260807 20:17:47.511212 6152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.510064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:37891 (local address 127.30.35.193:42423)
0807 20:17:47.510127 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:47.510140 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:47.510186 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:47.510401 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:47.510402 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:47.510404 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:47.510815 (+ 411us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:17:47.510816 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:47.510826 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:17:47.510858 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:47.511060 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:47.511061 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:47.511061 (+ 0us) client_negotiation.cc:769] Sending connection context
0807 20:17:47.511106 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:17:47.511120 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260807 20:17:47.511231 6637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.510156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:39295 (local address 127.30.35.193:52153)
0807 20:17:47.510343 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:47.510353 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:47.510404 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:47.510509 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:47.510510 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:47.510512 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:47.510887 (+ 375us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:17:47.510887 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:47.510893 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:17:47.510902 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:47.511060 (+ 158us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:47.511061 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:47.511061 (+ 0us) client_negotiation.cc:769] Sending connection context
0807 20:17:47.511107 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 20:17:47.511148 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":26,"thread_start_us":114,"threads_started":1}
I20260807 20:17:47.511570 6527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cf9812626c141f9b72d31bc547c94b0" candidate_uuid: "01a261b254ef44e7adcbafde664b8c57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "285251e581eb476ca0ca06da1775a2a6" is_pre_election: true
I20260807 20:17:47.511724 6527 raft_consensus.cc:2454] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a261b254ef44e7adcbafde664b8c57 in term 0.
I20260807 20:17:47.511816 6296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cf9812626c141f9b72d31bc547c94b0" candidate_uuid: "01a261b254ef44e7adcbafde664b8c57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13afb4ac487344d8a9715b969fb41ef0" is_pre_election: true
I20260807 20:17:47.511956 6296 raft_consensus.cc:2454] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 01a261b254ef44e7adcbafde664b8c57 in term 0.
I20260807 20:17:47.512001 5921 leader_election.cc:302] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a261b254ef44e7adcbafde664b8c57, 285251e581eb476ca0ca06da1775a2a6; no voters:
I20260807 20:17:47.512125 6634 raft_consensus.cc:2781] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:47.512187 6634 raft_consensus.cc:482] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:47.512208 6634 raft_consensus.cc:3037] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:47.512923 6634 raft_consensus.cc:504] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a261b254ef44e7adcbafde664b8c57" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 40695 } } peers { permanent_uuid: "13afb4ac487344d8a9715b969fb41ef0" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37891 } } peers { permanent_uuid: "285251e581eb476ca0ca06da1775a2a6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39295 } }
I20260807 20:17:47.513031 6634 leader_election.cc:288] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [CANDIDATE]: Term 1 election: Requested vote from peers 13afb4ac487344d8a9715b969fb41ef0 (127.30.35.194:37891), 285251e581eb476ca0ca06da1775a2a6 (127.30.35.195:39295)
I20260807 20:17:47.513204 6296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cf9812626c141f9b72d31bc547c94b0" candidate_uuid: "01a261b254ef44e7adcbafde664b8c57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13afb4ac487344d8a9715b969fb41ef0"
I20260807 20:17:47.513208 6527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cf9812626c141f9b72d31bc547c94b0" candidate_uuid: "01a261b254ef44e7adcbafde664b8c57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "285251e581eb476ca0ca06da1775a2a6"
I20260807 20:17:47.513280 6527 raft_consensus.cc:3037] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:47.513280 6296 raft_consensus.cc:3037] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:47.514001 6527 raft_consensus.cc:2454] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a261b254ef44e7adcbafde664b8c57 in term 1.
I20260807 20:17:47.514079 6296 raft_consensus.cc:2454] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 01a261b254ef44e7adcbafde664b8c57 in term 1.
I20260807 20:17:47.514159 5921 leader_election.cc:302] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 01a261b254ef44e7adcbafde664b8c57, 285251e581eb476ca0ca06da1775a2a6; no voters:
I20260807 20:17:47.514266 6634 raft_consensus.cc:2781] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:47.514434 6634 raft_consensus.cc:686] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [term 1 LEADER]: Becoming Leader. State: Replica: 01a261b254ef44e7adcbafde664b8c57, State: Running, Role: LEADER
I20260807 20:17:47.514537 6634 consensus_queue.cc:237] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a261b254ef44e7adcbafde664b8c57" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 40695 } } peers { permanent_uuid: "13afb4ac487344d8a9715b969fb41ef0" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37891 } } peers { permanent_uuid: "285251e581eb476ca0ca06da1775a2a6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39295 } }
I20260807 20:17:47.515323 5783 catalog_manager.cc:5495] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 reported cstate change: term changed from 0 to 1, leader changed from <none> to 01a261b254ef44e7adcbafde664b8c57 (127.30.35.193). New cstate: current_term: 1 leader_uuid: "01a261b254ef44e7adcbafde664b8c57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "01a261b254ef44e7adcbafde664b8c57" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 40695 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13afb4ac487344d8a9715b969fb41ef0" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "285251e581eb476ca0ca06da1775a2a6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39295 } health_report { overall_health: UNKNOWN } } }
I20260807 20:17:47.521377 6618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.520507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47990 (local address 127.30.35.193:40695)
0807 20:17:47.520560 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.520562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.520570 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:47.520634 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.520635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.520648 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.520695 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:47.521174 (+ 479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:47.521175 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:47.521176 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:47.521179 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:47.521194 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:47.521199 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:47.521247 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:47.521293 (+ 46us) server_negotiation.cc:299] Negotiation successful
0807 20:17:47.521307 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 20:17:47.522991 6296 raft_consensus.cc:1261] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0 [term 1 FOLLOWER]: Refusing update from remote peer 01a261b254ef44e7adcbafde664b8c57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:47.523005 6527 raft_consensus.cc:1261] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6 [term 1 FOLLOWER]: Refusing update from remote peer 01a261b254ef44e7adcbafde664b8c57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:47.523335 6639 consensus_queue.cc:1035] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13afb4ac487344d8a9715b969fb41ef0" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:47.523470 6634 consensus_queue.cc:1035] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "285251e581eb476ca0ca06da1775a2a6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:47.525712 6644 mvcc.cc:205] Tried to move back new op lower bound from 7316004321371762688 to 7316004321340157952. Current Snapshot: MvccSnapshot[applied={T|T < 7316004321371762688}]
I20260807 20:17:47.526149 6646 mvcc.cc:205] Tried to move back new op lower bound from 7316004321371762688 to 7316004321340157952. Current Snapshot: MvccSnapshot[applied={T|T < 7316004321371762688 or (T in {7316004321371762688})}]
I20260807 20:17:47.528124 5783 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:47.528206 5783 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:47.528913 5783 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d575632dd584fe38cba0dd4e7d2f58e: Sending DeleteTablet for 3 replicas of tablet 3cf9812626c141f9b72d31bc547c94b0
I20260807 20:17:47.529217 6018 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cf9812626c141f9b72d31bc547c94b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:47 UTC) from {username='slave'} at 127.0.0.1:47986
I20260807 20:17:47.529431 6657 tablet_replica.cc:330] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57: stopping tablet replica
I20260807 20:17:47.529450 6487 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cf9812626c141f9b72d31bc547c94b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:47 UTC) from {username='slave'} at 127.0.0.1:56250
I20260807 20:17:47.529587 6657 raft_consensus.cc:2229] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:17:47.529670 6267 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cf9812626c141f9b72d31bc547c94b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:47 UTC) from {username='slave'} at 127.0.0.1:37278
I20260807 20:17:47.529695 6659 tablet_replica.cc:330] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6: stopping tablet replica
I20260807 20:17:47.529788 6659 raft_consensus.cc:2229] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:47.529904 6659 raft_consensus.cc:2258] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:47.529906 6657 raft_consensus.cc:2258] T 3cf9812626c141f9b72d31bc547c94b0 P 01a261b254ef44e7adcbafde664b8c57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:47.530109 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 5896
I20260807 20:17:47.537465 6659 ts_tablet_manager.cc:1905] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:47.539892 6660 tablet_replica.cc:330] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0: stopping tablet replica
I20260807 20:17:47.539888 6659 ts_tablet_manager.cc:1918] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:47.539973 6659 log.cc:1196] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/3cf9812626c141f9b72d31bc547c94b0
I20260807 20:17:47.540014 6660 raft_consensus.cc:2229] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:47.540132 6660 raft_consensus.cc:2258] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:47.540223 6659 ts_tablet_manager.cc:1939] T 3cf9812626c141f9b72d31bc547c94b0 P 285251e581eb476ca0ca06da1775a2a6: Deleting consensus metadata
I20260807 20:17:47.540647 5759 catalog_manager.cc:4841] TS 285251e581eb476ca0ca06da1775a2a6 (127.30.35.195:39295): tablet 3cf9812626c141f9b72d31bc547c94b0 (table test-table [id=8aefcfbd480d4829870e8fb586913729]) successfully deleted
I20260807 20:17:47.540688 6660 ts_tablet_manager.cc:1905] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:47.541849 6660 ts_tablet_manager.cc:1918] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:47.541914 6660 log.cc:1196] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/3cf9812626c141f9b72d31bc547c94b0
I20260807 20:17:47.542119 6660 ts_tablet_manager.cc:1939] T 3cf9812626c141f9b72d31bc547c94b0 P 13afb4ac487344d8a9715b969fb41ef0: Deleting consensus metadata
I20260807 20:17:47.542498 5759 catalog_manager.cc:4841] TS 13afb4ac487344d8a9715b969fb41ef0 (127.30.35.194:37891): tablet 3cf9812626c141f9b72d31bc547c94b0 (table test-table [id=8aefcfbd480d4829870e8fb586913729]) successfully deleted
W20260807 20:17:47.544384 5763 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:40695 (error 108)
I20260807 20:17:47.544605 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 6154
I20260807 20:17:47.546443 6617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.544803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:40695 (local address 127.0.0.1:47998)
0807 20:17:47.546347 (+ 1544us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:47.546408 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:40695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1519}
W20260807 20:17:47.550478 5763 catalog_manager.cc:4584] TS 01a261b254ef44e7adcbafde664b8c57 (127.30.35.193:40695): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3cf9812626c141f9b72d31bc547c94b0: Network error: Client connection negotiation failed: client connection to 127.30.35.193:40695: connect: Connection refused (error 111)
I20260807 20:17:47.565856 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 6378
I20260807 20:17:47.573618 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 5719
2026-08-07T20:17:47Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (629 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 20:17:47.596961 30863 mini_oidc.cc:152] Starting JWKS server
I20260807 20:17:47.598255 30863 webserver.cc:460] Webserver started at https://127.0.0.1:41311/ using document root <none> and password file <none>
I20260807 20:17:47.598340 30863 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 20:17:47.598472 30863 webserver.cc:460] Webserver started at http://127.0.0.1:34937/ using document root <none> and password file <none>
2026-08-07T20:17:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:47Z Disabled control of system clock
I20260807 20:17:47.606709 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:38201
--webserver_interface=127.30.35.254
--webserver_port=0
--builtin_ntp_servers=127.30.35.212:46171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:38201
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41311/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/testchainca.cert with env {}
W20260807 20:17:47.686769 6679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:47.686980 6679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:47.687000 6679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:47.688119 6679 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:47.688155 6679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:47.688166 6679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:47.688177 6679 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:47.688187 6679 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 20:17:47.688201 6679 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 20:17:47.688211 6679 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41311/jwks.json
I20260807 20:17:47.689782 6679 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:46171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:38201
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:38201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41311/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6679
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:47.689987 6679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:47.690165 6679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:47.694835 6686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:47.694882 6687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:47.695051 6679 server_base.cc:1034] running on GCE node
W20260807 20:17:47.694897 6689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:47.695323 6679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:47.695592 6679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:47.696738 6679 hybrid_clock.cc:648] HybridClock initialized: now 1786133867696717 us; error 33 us; skew 500 ppm
I20260807 20:17:47.697908 6679 webserver.cc:460] Webserver started at http://127.30.35.254:40029/ using document root <none> and password file <none>
I20260807 20:17:47.698122 6679 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:47.698169 6679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:47.698294 6679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:47.699285 6679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "1830b0f313c84d30adf0c35253cbaac8"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "52c6cb90180e6e12b02cffdfcb08995c"
server_key_iv: "288e6512c965a8c88cb36f3477780ef1"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.699605 6679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "1830b0f313c84d30adf0c35253cbaac8"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "52c6cb90180e6e12b02cffdfcb08995c"
server_key_iv: "288e6512c965a8c88cb36f3477780ef1"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.700811 6679 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:17:47.701468 6699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:47.701632 6679 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:47.701748 6679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "1830b0f313c84d30adf0c35253cbaac8"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "52c6cb90180e6e12b02cffdfcb08995c"
server_key_iv: "288e6512c965a8c88cb36f3477780ef1"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.701808 6679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:47.710887 6679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:47.711148 6679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:47.711268 6679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:47.714946 6679 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:38201
I20260807 20:17:47.714978 6795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:38201 every 8 connection(s)
I20260807 20:17:47.715281 6679 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:47.716271 6796 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:47.718513 6796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8: Bootstrap starting.
I20260807 20:17:47.719084 6796 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:47.719348 6796 log.cc:824] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:47.719964 6796 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8: No bootstrap required, opened a new log
I20260807 20:17:47.720813 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 6679
I20260807 20:17:47.720901 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:47.721069 30863 external_mini_cluster.cc:1428] Setting key 78ece1ba322444389a06d5f5e122b376
I20260807 20:17:47.721699 6796 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1830b0f313c84d30adf0c35253cbaac8" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38201 } }
I20260807 20:17:47.721879 6796 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:47.721921 6796 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1830b0f313c84d30adf0c35253cbaac8, State: Initialized, Role: FOLLOWER
I20260807 20:17:47.722045 6796 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1830b0f313c84d30adf0c35253cbaac8" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38201 } }
I20260807 20:17:47.722121 6796 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:47.722201 6796 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:47.722256 6796 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:47.722751 6796 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1830b0f313c84d30adf0c35253cbaac8" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38201 } }
I20260807 20:17:47.722848 6796 leader_election.cc:302] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1830b0f313c84d30adf0c35253cbaac8; no voters:
I20260807 20:17:47.723008 6796 leader_election.cc:288] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:47.723057 6809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:47.723201 6809 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [term 1 LEADER]: Becoming Leader. State: Replica: 1830b0f313c84d30adf0c35253cbaac8, State: Running, Role: LEADER
I20260807 20:17:47.723268 6796 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:47.723330 6809 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1830b0f313c84d30adf0c35253cbaac8" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38201 } }
I20260807 20:17:47.723678 6809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1830b0f313c84d30adf0c35253cbaac8. Latest consensus state: current_term: 1 leader_uuid: "1830b0f313c84d30adf0c35253cbaac8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1830b0f313c84d30adf0c35253cbaac8" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38201 } } }
I20260807 20:17:47.723728 6810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1830b0f313c84d30adf0c35253cbaac8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1830b0f313c84d30adf0c35253cbaac8" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38201 } } }
I20260807 20:17:47.723927 6810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:47.723850 6809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8 [sys.catalog]: This master's current role is: LEADER
W20260807 20:17:47.725069 6828 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:17:47.725116 6828 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:17:47.725719 6822 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:47.725943 6822 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:47.727074 6808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.721575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59688 (local address 127.30.35.254:38201)
0807 20:17:47.721794 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.721803 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.721837 (+ 34us) server_negotiation.cc:407] Connection header received
0807 20:17:47.721961 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.721968 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.722038 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.722183 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:47.722388 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:47.723857 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:47.724931 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:47.725507 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:47.725629 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:47.726360 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:47.726364 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:47.726365 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:47.726566 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:47.726607 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:47.726622 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:47.726692 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:47.726776 (+ 84us) server_negotiation.cc:299] Negotiation successful
0807 20:17:47.726854 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":98,"threads_started":1}
I20260807 20:17:47.727545 6822 catalog_manager.cc:1347] Generated new cluster ID: e8d0b1b9da3e46e1b4d3a6ffd910af0a
I20260807 20:17:47.727636 6822 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:17:47.727967 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:17:47.739351 6822 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:47.739872 6822 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:47.742522 6822 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1830b0f313c84d30adf0c35253cbaac8: Generated new TSK 0
I20260807 20:17:47.742686 6822 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 20:17:47.765710 6841 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 20:17:47.765865 6841 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 20:17:47.766019 6808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.750737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59696 (local address 127.30.35.254:38201)
0807 20:17:47.750795 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.750797 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.750956 (+ 159us) server_negotiation.cc:407] Connection header received
0807 20:17:47.751066 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.751067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.751087 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.751144 (+ 57us) server_negotiation.cc:226] Negotiated authn=JWT
0807 20:17:47.751299 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:47.751799 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:47.752920 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:47.753092 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:47.753134 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:47.753364 (+ 230us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 20:17:47.765774 (+ 12410us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 20:17:47.765952 (+ 178us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59696: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":33}
W20260807 20:17:47.766247 6808 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59696: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 20:17:47.766556 6839 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:17:47.750663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:38201 (local address 127.0.0.1:59696)
0807 20:17:47.750879 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:47.750891 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:47.750973 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:47.751170 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:47.751171 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:47.751173 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 20:17:47.751241 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:47.751243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:47.751872 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:47.751874 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:47.752849 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:47.752851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:47.753166 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:47.753167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:47.753240 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:47.753266 (+ 26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 20:17:47.765986 (+ 12720us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 20:17:47.766123 (+ 137us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.35.254:38201: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":95,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.30.35.254:38201: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41311/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 20:17:47.766974 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 6679
2026-08-07T20:17:47Z chronyd exiting
I20260807 20:17:47.812398 30863 test_util.cc:175] -----------------------------------------------
I20260807 20:17:47.812486 30863 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786133844183963-30863-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (216 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 20:17:47.813256 30863 mini_oidc.cc:152] Starting JWKS server
I20260807 20:17:47.813971 30863 webserver.cc:460] Webserver started at https://127.0.0.1:40441/ using document root <none> and password file <none>
I20260807 20:17:47.814018 30863 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 20:17:47.814128 30863 webserver.cc:460] Webserver started at http://127.0.0.1:33373/ using document root <none> and password file <none>
2026-08-07T20:17:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:47Z Disabled control of system clock
I20260807 20:17:47.822588 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:36941
--webserver_interface=127.30.35.254
--webserver_port=0
--builtin_ntp_servers=127.30.35.212:42403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:36941
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40441/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/testchainca.cert with env {}
W20260807 20:17:47.902630 6850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:47.902853 6850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:47.902874 6850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:47.903967 6850 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:47.903999 6850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:47.904011 6850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:47.904022 6850 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:47.904038 6850 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 20:17:47.904049 6850 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 20:17:47.904065 6850 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40441/jwks.json
I20260807 20:17:47.905500 6850 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:42403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:36941
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:36941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40441/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:47.905750 6850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:47.905956 6850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:47.910666 6864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:47.910741 6850 server_base.cc:1034] running on GCE node
W20260807 20:17:47.910761 6863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:47.910676 6867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:47.911101 6850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:47.911365 6850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:47.912509 6850 hybrid_clock.cc:648] HybridClock initialized: now 1786133867912492 us; error 33 us; skew 500 ppm
I20260807 20:17:47.913682 6850 webserver.cc:460] Webserver started at http://127.30.35.254:42111/ using document root <none> and password file <none>
I20260807 20:17:47.913913 6850 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:47.913960 6850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:47.914081 6850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:47.915097 6850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "72711ee2115b47e2a7a13c53bd1867ac"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "68d85f218e9cd5bbb4b24b0147a9c797"
server_key_iv: "53652bb0765b21a2616a0f3b7475116e"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.915441 6850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "72711ee2115b47e2a7a13c53bd1867ac"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "68d85f218e9cd5bbb4b24b0147a9c797"
server_key_iv: "53652bb0765b21a2616a0f3b7475116e"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.916641 6850 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:17:47.917280 6882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:47.917438 6850 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:47.917522 6850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "72711ee2115b47e2a7a13c53bd1867ac"
format_stamp: "Formatted at 2026-08-07 20:17:47 on dist-test-slave-t7g5"
server_key: "68d85f218e9cd5bbb4b24b0147a9c797"
server_key_iv: "53652bb0765b21a2616a0f3b7475116e"
server_key_version: "encryptionkey@0"
I20260807 20:17:47.917585 6850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:47.933560 6850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:47.933925 6850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:47.934062 6850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:47.937939 6850 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:36941
I20260807 20:17:47.937983 6983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:36941 every 8 connection(s)
I20260807 20:17:47.938294 6850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:47.938932 6985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:47.941502 6985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac: Bootstrap starting.
I20260807 20:17:47.942138 6985 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:47.942376 6985 log.cc:824] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:47.943012 6985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac: No bootstrap required, opened a new log
I20260807 20:17:47.944542 6985 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72711ee2115b47e2a7a13c53bd1867ac" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36941 } }
I20260807 20:17:47.944679 6985 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:47.944700 6985 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72711ee2115b47e2a7a13c53bd1867ac, State: Initialized, Role: FOLLOWER
I20260807 20:17:47.944819 6985 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72711ee2115b47e2a7a13c53bd1867ac" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36941 } }
I20260807 20:17:47.944871 6985 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:47.944890 6985 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:47.944919 6985 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:47.945407 6985 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72711ee2115b47e2a7a13c53bd1867ac" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36941 } }
I20260807 20:17:47.945500 6985 leader_election.cc:302] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72711ee2115b47e2a7a13c53bd1867ac; no voters:
I20260807 20:17:47.945618 6985 leader_election.cc:288] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:47.945677 6989 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:47.945842 6989 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [term 1 LEADER]: Becoming Leader. State: Replica: 72711ee2115b47e2a7a13c53bd1867ac, State: Running, Role: LEADER
I20260807 20:17:47.945873 6985 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:47.945935 6989 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72711ee2115b47e2a7a13c53bd1867ac" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36941 } }
I20260807 20:17:47.946291 6990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72711ee2115b47e2a7a13c53bd1867ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72711ee2115b47e2a7a13c53bd1867ac" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36941 } } }
I20260807 20:17:47.946426 6990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:47.946467 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 6850
I20260807 20:17:47.946450 6991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72711ee2115b47e2a7a13c53bd1867ac. Latest consensus state: current_term: 1 leader_uuid: "72711ee2115b47e2a7a13c53bd1867ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72711ee2115b47e2a7a13c53bd1867ac" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36941 } } }
I20260807 20:17:47.946525 6991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:47.946561 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:47.946743 30863 external_mini_cluster.cc:1428] Setting key 42f2750ba4b6ff919e98612b6d83edbd
I20260807 20:17:47.946890 6995 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:47.947448 6995 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:47.949254 6995 catalog_manager.cc:1347] Generated new cluster ID: f22d70948e4a4dde8e8db927b689fe5e
I20260807 20:17:47.949308 6995 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:17:47.952661 7013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.947238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54158 (local address 127.30.35.254:36941)
0807 20:17:47.947446 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.947455 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.947490 (+ 35us) server_negotiation.cc:407] Connection header received
0807 20:17:47.947613 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.947621 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.947691 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.948084 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:47.948180 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:47.949323 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:47.950490 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:47.951101 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:47.951207 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:47.951896 (+ 689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:47.951900 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:47.951901 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:47.952109 (+ 208us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:47.952150 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:47.952164 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:47.952218 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:47.952292 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 20:17:47.952451 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":85,"threads_started":1}
I20260807 20:17:47.953541 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:17:47.957222 6995 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:47.957926 6995 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:47.961448 6995 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72711ee2115b47e2a7a13c53bd1867ac: Generated new TSK 0
I20260807 20:17:47.961611 6995 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 20:17:47.991209 7046 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 20:17:47.991302 7046 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 20:17:47.991572 7013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:47.969837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54168 (local address 127.30.35.254:36941)
0807 20:17:47.969905 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:47.969907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:47.969993 (+ 86us) server_negotiation.cc:407] Connection header received
0807 20:17:47.970078 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:47.970079 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:47.970090 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:47.970146 (+ 56us) server_negotiation.cc:226] Negotiated authn=JWT
0807 20:17:47.970271 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:47.970742 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:47.971853 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:47.972063 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:47.972109 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:47.972270 (+ 161us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 20:17:47.991324 (+ 19054us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40441/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 20:17:47.991489 (+ 165us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54168: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40441/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":31}
W20260807 20:17:47.991642 7013 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54168: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40441/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 20:17:47.991699 7044 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:17:47.969771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:36941 (local address 127.0.0.1:54168)
0807 20:17:47.969932 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:47.969943 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:47.970013 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:47.970147 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:47.970148 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:47.970150 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 20:17:47.970214 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:47.970216 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:47.970824 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:47.970825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:47.971775 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:47.971778 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:47.972126 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:47.972127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:47.972187 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:47.972193 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 20:17:47.991491 (+ 19298us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40441/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 20:17:47.991603 (+ 112us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.35.254:36941: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40441/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":83,"threads_started":1}
I20260807 20:17:47.991999 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 6850
2026-08-07T20:17:48Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (223 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 20:17:48.036541 30863 mini_oidc.cc:152] Starting JWKS server
I20260807 20:17:48.037215 30863 webserver.cc:460] Webserver started at https://127.0.0.1:34595/ using document root <none> and password file <none>
I20260807 20:17:48.037257 30863 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 20:17:48.037366 30863 webserver.cc:460] Webserver started at http://127.0.0.1:35703/ using document root <none> and password file <none>
2026-08-07T20:17:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:48Z Disabled control of system clock
I20260807 20:17:48.046005 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:44657
--webserver_interface=127.30.35.254
--webserver_port=0
--builtin_ntp_servers=127.30.35.212:42941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:44657
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34595/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 20:17:48.126233 7053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:48.126464 7053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:48.126493 7053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:48.127651 7053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:48.127691 7053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:48.127708 7053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:48.127724 7053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:48.127740 7053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 20:17:48.127758 7053 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 20:17:48.127779 7053 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34595/jwks.json
I20260807 20:17:48.129114 7053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:42941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:44657
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:44657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34595/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:48.129369 7053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:48.129671 7053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:48.134265 7062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:48.134243 7063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:48.134261 7065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:48.134295 7053 server_base.cc:1034] running on GCE node
I20260807 20:17:48.134687 7053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:48.134979 7053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:48.136119 7053 hybrid_clock.cc:648] HybridClock initialized: now 1786133868136101 us; error 33 us; skew 500 ppm
I20260807 20:17:48.137253 7053 webserver.cc:460] Webserver started at http://127.30.35.254:40973/ using document root <none> and password file <none>
I20260807 20:17:48.137457 7053 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:48.137499 7053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:48.137624 7053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:48.138706 7053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "385b3bb8d3bc4320a918912ad28ee626"
format_stamp: "Formatted at 2026-08-07 20:17:48 on dist-test-slave-t7g5"
server_key: "8c9052419a9ab9e80c1a0a6a85df36ae"
server_key_iv: "4d28e289012aa6d68eb7d680564e0cc0"
server_key_version: "encryptionkey@0"
I20260807 20:17:48.139038 7053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "385b3bb8d3bc4320a918912ad28ee626"
format_stamp: "Formatted at 2026-08-07 20:17:48 on dist-test-slave-t7g5"
server_key: "8c9052419a9ab9e80c1a0a6a85df36ae"
server_key_iv: "4d28e289012aa6d68eb7d680564e0cc0"
server_key_version: "encryptionkey@0"
I20260807 20:17:48.140232 7053 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:48.140846 7074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:48.140992 7053 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:48.141075 7053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "385b3bb8d3bc4320a918912ad28ee626"
format_stamp: "Formatted at 2026-08-07 20:17:48 on dist-test-slave-t7g5"
server_key: "8c9052419a9ab9e80c1a0a6a85df36ae"
server_key_iv: "4d28e289012aa6d68eb7d680564e0cc0"
server_key_version: "encryptionkey@0"
I20260807 20:17:48.141134 7053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:48.161119 7053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:48.161439 7053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:48.161576 7053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:48.165313 7053 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:44657
I20260807 20:17:48.165357 7166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:44657 every 8 connection(s)
I20260807 20:17:48.165699 7053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:48.166332 7168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:48.168951 7168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626: Bootstrap starting.
I20260807 20:17:48.169507 7168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:48.169786 7168 log.cc:824] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:48.170053 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 7053
I20260807 20:17:48.170138 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:48.170325 30863 external_mini_cluster.cc:1428] Setting key a6ba786bb0b093c226302040aff51c84
I20260807 20:17:48.170538 7168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626: No bootstrap required, opened a new log
I20260807 20:17:48.172727 7168 raft_consensus.cc:348] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "385b3bb8d3bc4320a918912ad28ee626" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44657 } }
I20260807 20:17:48.172864 7168 raft_consensus.cc:374] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:48.172895 7168 raft_consensus.cc:729] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 385b3bb8d3bc4320a918912ad28ee626, State: Initialized, Role: FOLLOWER
I20260807 20:17:48.173017 7168 consensus_queue.cc:260] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "385b3bb8d3bc4320a918912ad28ee626" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44657 } }
I20260807 20:17:48.173089 7168 raft_consensus.cc:388] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:48.173118 7168 raft_consensus.cc:482] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:48.173163 7168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:48.173719 7168 raft_consensus.cc:504] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "385b3bb8d3bc4320a918912ad28ee626" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44657 } }
I20260807 20:17:48.173820 7168 leader_election.cc:302] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 385b3bb8d3bc4320a918912ad28ee626; no voters:
I20260807 20:17:48.173967 7168 leader_election.cc:288] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:48.174005 7175 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:48.174124 7175 raft_consensus.cc:686] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [term 1 LEADER]: Becoming Leader. State: Replica: 385b3bb8d3bc4320a918912ad28ee626, State: Running, Role: LEADER
I20260807 20:17:48.174223 7168 sys_catalog.cc:564] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:48.174290 7175 consensus_queue.cc:237] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "385b3bb8d3bc4320a918912ad28ee626" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44657 } }
I20260807 20:17:48.174639 7175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 385b3bb8d3bc4320a918912ad28ee626. Latest consensus state: current_term: 1 leader_uuid: "385b3bb8d3bc4320a918912ad28ee626" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "385b3bb8d3bc4320a918912ad28ee626" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44657 } } }
I20260807 20:17:48.174861 7175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:48.175091 7188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:48.175381 7176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "385b3bb8d3bc4320a918912ad28ee626" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "385b3bb8d3bc4320a918912ad28ee626" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44657 } } }
I20260807 20:17:48.175477 7176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:48.175926 7174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:48.170804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44444 (local address 127.30.35.254:44657)
0807 20:17:48.171017 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:48.171025 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:48.171049 (+ 24us) server_negotiation.cc:407] Connection header received
0807 20:17:48.171694 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:48.171701 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:48.171764 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:48.171887 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:48.172091 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:48.172981 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:48.173798 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:48.174395 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:48.174507 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:48.175212 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:48.175216 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:48.175217 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:48.175429 (+ 212us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:48.175486 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:48.175502 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:48.175563 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:48.175715 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 20:17:48.175784 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":86,"threads_started":1}
I20260807 20:17:48.176020 7188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:48.176836 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:17:48.177907 7188 catalog_manager.cc:1347] Generated new cluster ID: f2209144694545e99e666d1075515189
I20260807 20:17:48.177964 7188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:17:48.198666 7188 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:48.199376 7188 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:48.206250 7188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 385b3bb8d3bc4320a918912ad28ee626: Generated new TSK 0
I20260807 20:17:48.206454 7188 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:17:48.216346 7174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:48.213151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44450 (local address 127.30.35.254:44657)
0807 20:17:48.213198 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:48.213201 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:48.213288 (+ 87us) server_negotiation.cc:407] Connection header received
0807 20:17:48.213363 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:48.213364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:48.213377 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:48.213444 (+ 67us) server_negotiation.cc:226] Negotiated authn=JWT
0807 20:17:48.213575 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:48.214118 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:48.214864 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:48.215084 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:48.215138 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:48.215307 (+ 169us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 20:17:48.216155 (+ 848us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 20:17:48.216281 (+ 126us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44450: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":23}
W20260807 20:17:48.216398 7174 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44450: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260807 20:17:48.216481 7215 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:17:48.213082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:44657 (local address 127.0.0.1:44450)
0807 20:17:48.213231 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:48.213240 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:48.213297 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:48.213444 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:48.213445 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:48.213447 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 20:17:48.213518 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:48.213521 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:48.214194 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:48.214195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:48.214794 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:48.214796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:48.215151 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:48.215152 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:48.215215 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:48.215220 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 20:17:48.216258 (+ 1038us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 20:17:48.216374 (+ 116us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.35.254:44657: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34595/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":77,"threads_started":1}
I20260807 20:17:48.216928 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 7053
E20260807 20:17:48.233299 7216 webserver.cc:533] Webserver: sslize failed:
E20260807 20:17:48.233377 7216 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-07T20:17:48Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (227 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T20:17:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:48Z Disabled control of system clock
I20260807 20:17:48.272558 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:35415
--webserver_interface=127.30.35.254
--webserver_port=0
--builtin_ntp_servers=127.30.35.212:44843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:35415
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/testchainca.cert with env {}
W20260807 20:17:48.352278 7226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:48.352509 7226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:48.352540 7226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:48.353734 7226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:48.353775 7226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:48.353791 7226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:48.353807 7226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:48.353822 7226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 20:17:48.353842 7226 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 20:17:48.353858 7226 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 20:17:48.355376 7226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:44843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:35415
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:35415
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:48.355655 7226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:48.355854 7226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:48.360432 7234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:48.360472 7241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:48.360507 7226 server_base.cc:1034] running on GCE node
W20260807 20:17:48.360472 7236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:48.360913 7226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:48.361166 7226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:48.362295 7226 hybrid_clock.cc:648] HybridClock initialized: now 1786133868362282 us; error 29 us; skew 500 ppm
I20260807 20:17:48.363536 7226 webserver.cc:460] Webserver started at http://127.30.35.254:35119/ using document root <none> and password file <none>
I20260807 20:17:48.363744 7226 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:48.363787 7226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:48.363906 7226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:48.364918 7226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "e40325db5dfb4e19bf0f6d58e678075f"
format_stamp: "Formatted at 2026-08-07 20:17:48 on dist-test-slave-t7g5"
server_key: "62777f49b2419b679f4860376921d961"
server_key_iv: "9aa69a33f1187a07c602c9b3ffc685f1"
server_key_version: "encryptionkey@0"
I20260807 20:17:48.365238 7226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "e40325db5dfb4e19bf0f6d58e678075f"
format_stamp: "Formatted at 2026-08-07 20:17:48 on dist-test-slave-t7g5"
server_key: "62777f49b2419b679f4860376921d961"
server_key_iv: "9aa69a33f1187a07c602c9b3ffc685f1"
server_key_version: "encryptionkey@0"
I20260807 20:17:48.366505 7226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:17:48.367185 7252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:48.367316 7226 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:17:48.367409 7226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "e40325db5dfb4e19bf0f6d58e678075f"
format_stamp: "Formatted at 2026-08-07 20:17:48 on dist-test-slave-t7g5"
server_key: "62777f49b2419b679f4860376921d961"
server_key_iv: "9aa69a33f1187a07c602c9b3ffc685f1"
server_key_version: "encryptionkey@0"
I20260807 20:17:48.367468 7226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:48.384543 7226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:48.384850 7226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:48.384984 7226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:48.388754 7226 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:35415
I20260807 20:17:48.388789 7350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:35415 every 8 connection(s)
I20260807 20:17:48.389106 7226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:48.390071 7351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:48.392280 7351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f: Bootstrap starting.
I20260807 20:17:48.392810 7351 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:48.393031 7351 log.cc:824] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:48.393635 7351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f: No bootstrap required, opened a new log
I20260807 20:17:48.395146 7351 raft_consensus.cc:348] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e40325db5dfb4e19bf0f6d58e678075f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 35415 } }
I20260807 20:17:48.395279 7351 raft_consensus.cc:374] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:48.395308 7351 raft_consensus.cc:729] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e40325db5dfb4e19bf0f6d58e678075f, State: Initialized, Role: FOLLOWER
I20260807 20:17:48.395427 7351 consensus_queue.cc:260] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e40325db5dfb4e19bf0f6d58e678075f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 35415 } }
I20260807 20:17:48.395514 7351 raft_consensus.cc:388] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:48.395542 7351 raft_consensus.cc:482] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:48.395572 7351 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:48.396015 7351 raft_consensus.cc:504] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e40325db5dfb4e19bf0f6d58e678075f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 35415 } }
I20260807 20:17:48.396098 7351 leader_election.cc:302] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e40325db5dfb4e19bf0f6d58e678075f; no voters:
I20260807 20:17:48.396222 7351 leader_election.cc:288] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:48.396266 7358 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:48.396435 7351 sys_catalog.cc:564] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:48.396445 7358 raft_consensus.cc:686] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [term 1 LEADER]: Becoming Leader. State: Replica: e40325db5dfb4e19bf0f6d58e678075f, State: Running, Role: LEADER
I20260807 20:17:48.396561 7358 consensus_queue.cc:237] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e40325db5dfb4e19bf0f6d58e678075f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 35415 } }
I20260807 20:17:48.396714 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 7226
I20260807 20:17:48.396814 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:48.397013 30863 external_mini_cluster.cc:1428] Setting key 485d5563986bb14db5624a1d430bf34b
I20260807 20:17:48.397382 7361 sys_catalog.cc:455] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e40325db5dfb4e19bf0f6d58e678075f. Latest consensus state: current_term: 1 leader_uuid: "e40325db5dfb4e19bf0f6d58e678075f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e40325db5dfb4e19bf0f6d58e678075f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 35415 } } }
I20260807 20:17:48.397471 7361 sys_catalog.cc:458] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:48.397817 7359 sys_catalog.cc:455] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e40325db5dfb4e19bf0f6d58e678075f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e40325db5dfb4e19bf0f6d58e678075f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 35415 } } }
I20260807 20:17:48.397904 7384 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:48.398469 7384 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:48.397961 7359 sys_catalog.cc:458] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:48.400780 7384 catalog_manager.cc:1347] Generated new cluster ID: af3146877f614e9c97aa48078aa86c19
I20260807 20:17:48.400837 7384 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:17:48.402881 7386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:48.397701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55576 (local address 127.30.35.254:35415)
0807 20:17:48.398206 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:48.398215 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:48.398251 (+ 36us) server_negotiation.cc:407] Connection header received
0807 20:17:48.398363 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:48.398370 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:48.398467 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:48.398647 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:48.398874 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:48.400007 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:48.400727 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:48.401298 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:48.401409 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:48.402211 (+ 802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:48.402215 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:48.402215 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:17:48.402406 (+ 191us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:48.402454 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:17:48.402468 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:48.402521 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:48.402606 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 20:17:48.402676 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":68,"threads_started":1}
I20260807 20:17:48.403744 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:17:48.407367 7384 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:48.407821 7384 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:48.412384 7384 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e40325db5dfb4e19bf0f6d58e678075f: Generated new TSK 0
I20260807 20:17:48.412528 7384 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:17:48.461575 7386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:48.417735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55586 (local address 127.30.35.254:35415)
0807 20:17:48.417794 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:48.417796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:48.417892 (+ 96us) server_negotiation.cc:407] Connection header received
0807 20:17:48.417970 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:48.417970 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:48.417979 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:48.418034 (+ 55us) server_negotiation.cc:226] Negotiated authn=JWT
0807 20:17:48.418165 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:48.418629 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:48.419939 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:48.420123 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:48.420164 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:48.420316 (+ 152us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 20:17:48.461355 (+ 41039us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 20:17:48.461513 (+ 158us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55586: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":30}
W20260807 20:17:48.461642 7386 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55586: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 20:17:48.461825 7406 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:17:48.417696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:35415 (local address 127.0.0.1:55586)
0807 20:17:48.417824 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:48.417835 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:48.417907 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:48.418051 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:48.418052 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:48.418054 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0807 20:17:48.418111 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:48.418113 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:48.418911 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:48.418911 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:48.419856 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:48.419859 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:48.420182 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:48.420183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:48.420240 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:48.420247 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 20:17:48.461509 (+ 41262us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 20:17:48.461709 (+ 200us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.30.35.254:35415: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":73,"threads_started":1}
I20260807 20:17:48.462149 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 7226
2026-08-07T20:17:48Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (221 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (88 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (87 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:17:48 dist-test-slave-t7g5 krb5kdc[7428](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:17:48 dist-test-slave-t7g5 krb5kdc[7428](info): set up 2 sockets
Aug 07 20:17:48 dist-test-slave-t7g5 krb5kdc[7428](info): commencing operation
krb5kdc: starting...
W20260807 20:17:49.775803 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:17:49 dist-test-slave-t7g5 krb5kdc[7428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:17:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:17:49.890376 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:33215
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:46751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:33215
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:49.970881 7454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:49.971096 7454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:49.971117 7454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:49.972254 7454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:49.972296 7454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:49.972309 7454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:49.972321 7454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:49.972344 7454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:49.973803 7454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:46751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:33215
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:33215
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:49.974038 7454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:49.974234 7454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:49.978817 7465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:49.978902 7466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:49.978829 7469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:49.979022 7454 server_base.cc:1034] running on GCE node
I20260807 20:17:49.979287 7454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:49.979571 7454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:49.980708 7454 hybrid_clock.cc:648] HybridClock initialized: now 1786133869980696 us; error 27 us; skew 500 ppm
Aug 07 20:17:49 dist-test-slave-t7g5 krb5kdc[7428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133869, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:49.983047 7454 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:17:49.983464 7454 webserver.cc:460] Webserver started at http://127.30.35.254:42587/ using document root <none> and password file <none>
I20260807 20:17:49.983681 7454 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:49.983731 7454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:49.983857 7454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:49.984916 7454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "fbcc35036bab492c8ca49d358487ac2c"
format_stamp: "Formatted at 2026-08-07 20:17:49 on dist-test-slave-t7g5"
server_key: "be200cf3b03836955ce504cf158f6b87"
server_key_iv: "11c010bfe0b0e7ef268aa4205ba19d8d"
server_key_version: "encryptionkey@0"
I20260807 20:17:49.985249 7454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "fbcc35036bab492c8ca49d358487ac2c"
format_stamp: "Formatted at 2026-08-07 20:17:49 on dist-test-slave-t7g5"
server_key: "be200cf3b03836955ce504cf158f6b87"
server_key_iv: "11c010bfe0b0e7ef268aa4205ba19d8d"
server_key_version: "encryptionkey@0"
I20260807 20:17:49.986522 7454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:17:49.987169 7477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:49.987318 7454 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:49.987401 7454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "fbcc35036bab492c8ca49d358487ac2c"
format_stamp: "Formatted at 2026-08-07 20:17:49 on dist-test-slave-t7g5"
server_key: "be200cf3b03836955ce504cf158f6b87"
server_key_iv: "11c010bfe0b0e7ef268aa4205ba19d8d"
server_key_version: "encryptionkey@0"
I20260807 20:17:49.987462 7454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:50.015182 7454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:50.017455 7454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:50.017606 7454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:50.021678 7454 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:33215
I20260807 20:17:50.021726 7572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:33215 every 8 connection(s)
I20260807 20:17:50.022086 7454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:50.023397 7575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:50.025362 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 7454
I20260807 20:17:50.025461 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:50.025630 30863 external_mini_cluster.cc:1428] Setting key 940a26d99a121cbf76cf2ee53fa541ad
I20260807 20:17:50.026063 7575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c: Bootstrap starting.
I20260807 20:17:50.026757 7575 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:50.027194 7575 log.cc:824] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:50.027972 7575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c: No bootstrap required, opened a new log
I20260807 20:17:50.030056 7575 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbcc35036bab492c8ca49d358487ac2c" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33215 } }
I20260807 20:17:50.030236 7575 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:50.030263 7575 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbcc35036bab492c8ca49d358487ac2c, State: Initialized, Role: FOLLOWER
I20260807 20:17:50.030393 7575 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbcc35036bab492c8ca49d358487ac2c" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33215 } }
I20260807 20:17:50.030457 7575 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:50.030478 7575 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:50.030522 7575 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:50.031184 7575 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbcc35036bab492c8ca49d358487ac2c" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33215 } }
I20260807 20:17:50.031289 7575 leader_election.cc:302] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbcc35036bab492c8ca49d358487ac2c; no voters:
I20260807 20:17:50.031446 7575 leader_election.cc:288] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:50.031498 7583 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:50.031647 7583 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [term 1 LEADER]: Becoming Leader. State: Replica: fbcc35036bab492c8ca49d358487ac2c, State: Running, Role: LEADER
I20260807 20:17:50.031682 7575 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:50.031735 7583 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbcc35036bab492c8ca49d358487ac2c" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33215 } }
I20260807 20:17:50.032087 7586 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbcc35036bab492c8ca49d358487ac2c. Latest consensus state: current_term: 1 leader_uuid: "fbcc35036bab492c8ca49d358487ac2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbcc35036bab492c8ca49d358487ac2c" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33215 } } }
I20260807 20:17:50.032086 7584 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbcc35036bab492c8ca49d358487ac2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbcc35036bab492c8ca49d358487ac2c" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33215 } } }
I20260807 20:17:50.032191 7586 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:50.032195 7584 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:50.032379 7594 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:50.032922 7594 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:50.034425 7594 catalog_manager.cc:1347] Generated new cluster ID: b3aa7628782449cfae6f19820c70e690
I20260807 20:17:50.034467 7594 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:50.042520 7581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:50.026163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55484 (local address 127.30.35.254:33215)
0807 20:17:50.026353 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:50.026364 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:50.026402 (+ 38us) server_negotiation.cc:407] Connection header received
0807 20:17:50.027081 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:50.027092 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:50.027176 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:50.027347 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:50.028178 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.029066 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.030134 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.030669 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.030749 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:50.038981 (+ 8232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:50.038985 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:50.038986 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:50.038999 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:50.040850 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:50.041265 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:50.041268 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:50.041269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:50.041383 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:50.041572 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:50.041572 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:50.041573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:50.041899 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:50.042062 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:50.042163 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 20:17:50.042296 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":88,"threads_started":1}
I20260807 20:17:50.049256 7594 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:50.049845 7594 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:50.056039 7594 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbcc35036bab492c8ca49d358487ac2c: Generated new TSK 0
I20260807 20:17:50.056205 7594 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:17:50.086663 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33215
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:46751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:50.168496 7613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:50.168711 7613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:50.168743 7613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:50.169952 7613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:50.170001 7613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:50.170030 7613 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:17:50.171502 7613 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:46751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33215
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:50.171723 7613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:50.171950 7613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 20:17:50.177110 7613 server_base.cc:1034] running on GCE node
W20260807 20:17:50.177142 7621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:50.177146 7625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:50.177278 7622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:50.177487 7613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:50.177716 7613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:50.178856 7613 hybrid_clock.cc:648] HybridClock initialized: now 1786133870178842 us; error 31 us; skew 500 ppm
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:50.181208 7613 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:17:50.181639 7613 webserver.cc:460] Webserver started at http://127.30.35.193:34411/ using document root <none> and password file <none>
I20260807 20:17:50.181869 7613 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:50.181923 7613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:50.182045 7613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:50.183053 7613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "b894bc3b82f64630bf2a7c208c95a27c"
format_stamp: "Formatted at 2026-08-07 20:17:50 on dist-test-slave-t7g5"
server_key: "4e0dc49f82d9b7b59ea3e63011db3266"
server_key_iv: "e7757074bd7e832d4a3b11b59fb2649c"
server_key_version: "encryptionkey@0"
I20260807 20:17:50.183377 7613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "b894bc3b82f64630bf2a7c208c95a27c"
format_stamp: "Formatted at 2026-08-07 20:17:50 on dist-test-slave-t7g5"
server_key: "4e0dc49f82d9b7b59ea3e63011db3266"
server_key_iv: "e7757074bd7e832d4a3b11b59fb2649c"
server_key_version: "encryptionkey@0"
I20260807 20:17:50.184620 7613 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:17:50.185446 7636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:50.185843 7613 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:17:50.185952 7613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "b894bc3b82f64630bf2a7c208c95a27c"
format_stamp: "Formatted at 2026-08-07 20:17:50 on dist-test-slave-t7g5"
server_key: "4e0dc49f82d9b7b59ea3e63011db3266"
server_key_iv: "e7757074bd7e832d4a3b11b59fb2649c"
server_key_version: "encryptionkey@0"
I20260807 20:17:50.186025 7613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:50.202457 7613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:50.206998 7613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:50.207149 7613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:50.207368 7613 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:50.207690 7613 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:50.207729 7613 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:50.207760 7613 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:50.207783 7613 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:50.214813 7613 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:44503
I20260807 20:17:50.214851 7816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:44503 every 8 connection(s)
I20260807 20:17:50.215211 7613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:17:50.222450 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 7613
I20260807 20:17:50.222563 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:17:50.222750 30863 external_mini_cluster.cc:1428] Setting key 6427eeb5a8f39d9fb489cc1a3bf1184c
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:50.227645 7581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:50.215939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:37233 (local address 127.30.35.254:33215)
0807 20:17:50.215992 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:50.215994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:50.216229 (+ 235us) server_negotiation.cc:407] Connection header received
0807 20:17:50.217289 (+ 1060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:50.217291 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:50.217304 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:50.217372 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:50.218364 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.219127 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.220597 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.220893 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.220956 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:50.223821 (+ 2865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:50.223822 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:50.223823 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:50.223831 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:50.226327 (+ 2496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:50.226727 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:50.226729 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:50.226729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:50.226794 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:50.227021 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:50.227022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:50.227022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:50.227142 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:50.227200 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:50.227461 (+ 261us) server_negotiation.cc:299] Negotiation successful
0807 20:17:50.227557 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 20:17:50.227820 7821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:50.215925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33215 (local address 127.30.35.193:37233)
0807 20:17:50.216091 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:50.216138 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:50.217178 (+ 1040us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:50.217539 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:50.217544 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:50.217951 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:50.218259 (+ 308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:50.218266 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.219239 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.219240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:50.220514 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:50.220517 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.220971 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.220972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:50.221131 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:50.221628 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:50.221640 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:50.223726 (+ 2086us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:50.226423 (+ 2697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:50.226431 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:50.226433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:50.226655 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:50.226846 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:50.226847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:50.226847 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:50.226962 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:50.227194 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:50.227200 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:50.227339 (+ 139us) client_negotiation.cc:769] Sending connection context
0807 20:17:50.227438 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 20:17:50.227598 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260807 20:17:50.228475 7818 heartbeater.cc:347] Connected to a master server at 127.30.35.254:33215
I20260807 20:17:50.228586 7818 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:50.228785 7818 heartbeater.cc:511] Master 127.30.35.254:33215 requested a full tablet report, sending...
I20260807 20:17:50.229441 7506 ts_manager.cc:194] Registered new tserver with Master: b894bc3b82f64630bf2a7c208c95a27c (127.30.35.193:44503)
I20260807 20:17:50.230376 7506 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:37233
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:17:50.252187 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33215
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:46751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:50.333119 7828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:50.333344 7828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:50.333374 7828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:50.334547 7828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:50.334589 7828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:50.334616 7828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:17:50.336112 7828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:46751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33215
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:50.336334 7828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:50.336546 7828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:50.341281 7837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:50.341341 7838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:50.341271 7842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:50.341487 7828 server_base.cc:1034] running on GCE node
I20260807 20:17:50.341746 7828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:50.341981 7828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:50.343120 7828 hybrid_clock.cc:648] HybridClock initialized: now 1786133870343109 us; error 24 us; skew 500 ppm
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:50.345535 7828 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:17:50.345993 7828 webserver.cc:460] Webserver started at http://127.30.35.194:44535/ using document root <none> and password file <none>
I20260807 20:17:50.346200 7828 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:50.346248 7828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:50.346375 7828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:50.347429 7828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "ebc00c9c943d45d9a35fab2f035431bf"
format_stamp: "Formatted at 2026-08-07 20:17:50 on dist-test-slave-t7g5"
server_key: "3b311ebf4867d92d3be29296fa026dea"
server_key_iv: "2ad641e9cea7e56a65083e26a6cc3faa"
server_key_version: "encryptionkey@0"
I20260807 20:17:50.347751 7828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "ebc00c9c943d45d9a35fab2f035431bf"
format_stamp: "Formatted at 2026-08-07 20:17:50 on dist-test-slave-t7g5"
server_key: "3b311ebf4867d92d3be29296fa026dea"
server_key_iv: "2ad641e9cea7e56a65083e26a6cc3faa"
server_key_version: "encryptionkey@0"
I20260807 20:17:50.348942 7828 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:17:50.349566 7850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:50.349750 7828 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:50.349834 7828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "ebc00c9c943d45d9a35fab2f035431bf"
format_stamp: "Formatted at 2026-08-07 20:17:50 on dist-test-slave-t7g5"
server_key: "3b311ebf4867d92d3be29296fa026dea"
server_key_iv: "2ad641e9cea7e56a65083e26a6cc3faa"
server_key_version: "encryptionkey@0"
I20260807 20:17:50.349896 7828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:50.363582 7828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:50.365646 7828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:50.365804 7828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:50.366006 7828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:50.366289 7828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:50.366321 7828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:50.366350 7828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:50.366376 7828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:50.371745 7828 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:35569
I20260807 20:17:50.371801 8030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:35569 every 8 connection(s)
I20260807 20:17:50.372090 7828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:17:50.377383 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 7828
I20260807 20:17:50.377499 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:17:50.377703 30863 external_mini_cluster.cc:1428] Setting key 111b3495624df30711c8b8bcd02847c0
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:50.380878 7581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:50.372732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:50635 (local address 127.30.35.254:33215)
0807 20:17:50.372790 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:50.372792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:50.372997 (+ 205us) server_negotiation.cc:407] Connection header received
0807 20:17:50.374021 (+ 1024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:50.374022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:50.374033 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:50.374075 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:50.374648 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.375133 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.376152 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.376326 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.376367 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:50.378398 (+ 2031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:50.378400 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:50.378400 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:50.378408 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:50.379630 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:50.380009 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:50.380011 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:50.380011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:50.380069 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:50.380285 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:50.380286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:50.380286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:50.380398 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:50.380459 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:50.380711 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 20:17:50.380793 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 20:17:50.381050 8038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:50.372706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33215 (local address 127.30.35.194:50635)
0807 20:17:50.372870 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:50.372905 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:50.373901 (+ 996us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:50.374141 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:50.374144 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:50.374390 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:50.374585 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:50.374588 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.375192 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.375192 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:50.376091 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:50.376094 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.376375 (+ 281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.376376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:50.376477 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:50.376878 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:50.376886 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:50.378313 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:50.379704 (+ 1391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:50.379711 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:50.379713 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:50.379942 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:50.380122 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:50.380123 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:50.380123 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:50.380230 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:50.380458 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:50.380464 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:50.380595 (+ 131us) client_negotiation.cc:769] Sending connection context
0807 20:17:50.380681 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 20:17:50.380831 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
I20260807 20:17:50.381719 8031 heartbeater.cc:347] Connected to a master server at 127.30.35.254:33215
I20260807 20:17:50.381810 8031 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:50.381987 8031 heartbeater.cc:511] Master 127.30.35.254:33215 requested a full tablet report, sending...
I20260807 20:17:50.382364 7506 ts_manager.cc:194] Registered new tserver with Master: ebc00c9c943d45d9a35fab2f035431bf (127.30.35.194:35569)
I20260807 20:17:50.382737 7506 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:50635
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:17:50.401286 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33215
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:46751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:50.480535 8044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:50.480728 8044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:50.480749 8044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:50.481827 8044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:50.481858 8044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:50.481881 8044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:17:50.483284 8044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:46751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33215
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:50.483462 8044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:50.483629 8044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:50.488274 8051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:50.488272 8054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:50.488286 8050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:50.488487 8044 server_base.cc:1034] running on GCE node
I20260807 20:17:50.488695 8044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:50.488909 8044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:50.490047 8044 hybrid_clock.cc:648] HybridClock initialized: now 1786133870490029 us; error 34 us; skew 500 ppm
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:50.492457 8044 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:17:50.492841 8044 webserver.cc:460] Webserver started at http://127.30.35.195:41439/ using document root <none> and password file <none>
I20260807 20:17:50.493055 8044 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:50.493103 8044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:50.493227 8044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:50.494254 8044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "5f73d47974b84b72bd295f13fa7acbe6"
format_stamp: "Formatted at 2026-08-07 20:17:50 on dist-test-slave-t7g5"
server_key: "06206cf2d10772880df48b4e538bae15"
server_key_iv: "7a691811b26973b9e38dc277d7b3d183"
server_key_version: "encryptionkey@0"
I20260807 20:17:50.494576 8044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "5f73d47974b84b72bd295f13fa7acbe6"
format_stamp: "Formatted at 2026-08-07 20:17:50 on dist-test-slave-t7g5"
server_key: "06206cf2d10772880df48b4e538bae15"
server_key_iv: "7a691811b26973b9e38dc277d7b3d183"
server_key_version: "encryptionkey@0"
I20260807 20:17:50.495862 8044 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:50.496560 8067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:50.496712 8044 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:50.496795 8044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "5f73d47974b84b72bd295f13fa7acbe6"
format_stamp: "Formatted at 2026-08-07 20:17:50 on dist-test-slave-t7g5"
server_key: "06206cf2d10772880df48b4e538bae15"
server_key_iv: "7a691811b26973b9e38dc277d7b3d183"
server_key_version: "encryptionkey@0"
I20260807 20:17:50.496852 8044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:50.514776 8044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:50.516778 8044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:50.516922 8044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:50.517143 8044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:50.517455 8044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:50.517491 8044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:50.517521 8044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:50.517539 8044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:50.522871 8044 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:46441
I20260807 20:17:50.522922 8289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:46441 every 8 connection(s)
I20260807 20:17:50.523223 8044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:17:50.525600 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 8044
I20260807 20:17:50.525728 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:17:50.525906 30863 external_mini_cluster.cc:1428] Setting key 2c0a46d8fb2d58a227dea16479a1843f
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:17:50.532018 7581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:50.523895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:51175 (local address 127.30.35.254:33215)
0807 20:17:50.523953 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:50.523956 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:50.524164 (+ 208us) server_negotiation.cc:407] Connection header received
0807 20:17:50.525076 (+ 912us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:50.525077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:50.525088 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:50.525139 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:50.525766 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.526412 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.527481 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.527691 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.527743 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:50.529740 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:50.529742 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:50.529743 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:50.529750 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:50.530807 (+ 1057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:50.531171 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:50.531173 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:50.531173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:50.531238 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:50.531490 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:50.531491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:50.531491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:50.531590 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:50.531652 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:50.531871 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 20:17:50.531951 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 20:17:50.532227 8295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:50.523873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33215 (local address 127.30.35.195:51175)
0807 20:17:50.524051 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:50.524089 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:50.524990 (+ 901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:50.525197 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:50.525200 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:50.525463 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:50.525685 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:50.525692 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.526503 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.526504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:50.527407 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:50.527410 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.527774 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.527775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:50.527899 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:50.528301 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:50.528310 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:50.529624 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:50.530880 (+ 1256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:50.530887 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:50.530890 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:50.531105 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:50.531317 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:50.531318 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:50.531318 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:50.531442 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:50.531643 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:50.531648 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:50.531765 (+ 117us) client_negotiation.cc:769] Sending connection context
0807 20:17:50.531845 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 20:17:50.531986 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":97,"threads_started":1}
I20260807 20:17:50.532696 8291 heartbeater.cc:347] Connected to a master server at 127.30.35.254:33215
I20260807 20:17:50.532800 8291 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:50.532990 8291 heartbeater.cc:511] Master 127.30.35.254:33215 requested a full tablet report, sending...
I20260807 20:17:50.533352 7506 ts_manager.cc:194] Registered new tserver with Master: 5f73d47974b84b72bd295f13fa7acbe6 (127.30.35.195:46441)
I20260807 20:17:50.533727 7506 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:51175
I20260807 20:17:50.537446 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/test-admin.keytab.
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:50.553231 30863 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 20:17:50.554889 8304 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:17:50.554121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59762 (local address 127.30.35.193:44503)
0807 20:17:50.554297 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:50.554302 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:50.554311 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:50.554337 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:50.554339 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:50.554353 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:50.554417 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:50.554825 (+ 408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59762: BlockingRecv error: recv got EOF from 127.0.0.1:59762 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":102,"threads_started":1}
W20260807 20:17:50.555083 30863 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/krb5cc' of type FILE
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:50.556089 30863 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:50.556949 30863 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.193@KRBTEST.COM
I20260807 20:17:50.563796 8304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:50.557401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59772 (local address 127.30.35.193:44503)
0807 20:17:50.557447 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:50.557449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:50.557475 (+ 26us) server_negotiation.cc:407] Connection header received
0807 20:17:50.557544 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:50.557545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:50.557555 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:50.557598 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:50.557981 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.558693 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.559349 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.559642 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.559688 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:50.561490 (+ 1802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:50.561497 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:50.561497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:50.561503 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:50.562918 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:50.563199 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:50.563201 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:50.563201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:50.563253 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:50.563370 (+ 117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:50.563370 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:50.563370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:50.563491 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:50.563586 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:50.563635 (+ 49us) server_negotiation.cc:299] Negotiation successful
0807 20:17:50.563695 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
W20260807 20:17:50.565313 8304 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:17:50.564936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59776 (local address 127.30.35.193:44503)
0807 20:17:50.564970 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:50.564972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:50.564981 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:50.565035 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:50.565035 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:50.565043 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:50.565072 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:50.565268 (+ 196us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59776: BlockingRecv error: recv got EOF from 127.0.0.1:59776 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260807 20:17:50.565402 30863 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/krb5cc' of type FILE
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:50.566277 30863 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:50.567008 30863 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.193@KRBTEST.COM
I20260807 20:17:50.573001 8304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:50.567461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59782 (local address 127.30.35.193:44503)
0807 20:17:50.567512 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:50.567513 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:50.567522 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:50.567580 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:50.567581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:50.567590 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:50.567630 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:50.567954 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.568413 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.569043 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.569236 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.569289 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:50.571058 (+ 1769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:50.571059 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:50.571060 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:50.571066 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:50.572057 (+ 991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:50.572339 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:50.572340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:50.572341 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:50.572390 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:50.572555 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:50.572556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:50.572557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:50.572647 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:50.572726 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:50.572825 (+ 99us) server_negotiation.cc:299] Negotiation successful
0807 20:17:50.572901 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260807 20:17:50.574362 8304 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:17:50.573936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59786 (local address 127.30.35.193:44503)
0807 20:17:50.573984 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:50.573986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:50.573994 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:50.574032 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:50.574033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:50.574041 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:50.574084 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:50.574322 (+ 238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59786: BlockingRecv error: recv got EOF from 127.0.0.1:59786 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260807 20:17:50.574416 30863 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786133844183963-30863-0/krb5kdc/krb5cc' of type FILE
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:50.575224 30863 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:50.575947 30863 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[7428](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.193@KRBTEST.COM
I20260807 20:17:50.581526 8304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:50.576358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59802 (local address 127.30.35.193:44503)
0807 20:17:50.576404 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:50.576406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:50.576413 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:17:50.576476 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:50.576477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:50.576484 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:50.576522 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:50.576796 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.577253 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.577913 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:50.578093 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:50.578139 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:50.579784 (+ 1645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:50.579786 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:50.579786 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:50.579791 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:50.580786 (+ 995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:50.581046 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:50.581047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:50.581047 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:50.581088 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:50.581203 (+ 115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:50.581203 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:50.581203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:50.581274 (+ 71us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:50.581331 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:50.581403 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 20:17:50.581454 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 20:17:50.582216 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 7613
I20260807 20:17:50.593526 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 7828
I20260807 20:17:50.598527 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 8044
I20260807 20:17:50.605944 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 7454
2026-08-07T20:17:50Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1965 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[8322](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[8322](info): set up 2 sockets
Aug 07 20:17:50 dist-test-slave-t7g5 krb5kdc[8322](info): commencing operation
krb5kdc: starting...
W20260807 20:17:51.744988 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:17:51 dist-test-slave-t7g5 krb5kdc[8322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:17:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:51Z Disabled control of system clock
WARNING: no policy specified for oryx/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.254.keytab.
Entry for principal oryx/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.254.keytab.
I20260807 20:17:51.858578 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:34587
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.254.keytab
--principal=oryx/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:34587
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:51.938680 8351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:51.938936 8351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:51.938969 8351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:51.940229 8351 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:51.940281 8351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:51.940299 8351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:51.940315 8351 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:51.940330 8351 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:51.941877 8351 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:34587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.254.keytab
--principal=oryx/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:34587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8351
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:51.942133 8351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:51.942349 8351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:51.946902 8358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:51.946923 8359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:51.946895 8365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:51.947293 8351 server_base.cc:1034] running on GCE node
I20260807 20:17:51.947553 8351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:51.947836 8351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:51.948987 8351 hybrid_clock.cc:648] HybridClock initialized: now 1786133871948970 us; error 29 us; skew 500 ppm
Aug 07 20:17:51 dist-test-slave-t7g5 krb5kdc[8322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133871, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:51.956720 8351 init.cc:377] Logged in from keytab as oryx/127.30.35.254@KRBTEST.COM (short username oryx)
I20260807 20:17:51.957224 8351 webserver.cc:460] Webserver started at http://127.30.35.254:35745/ using document root <none> and password file <none>
I20260807 20:17:51.957448 8351 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:51.957499 8351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:51.957628 8351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:51.958717 8351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "e39e037a3a2f43a9baa7ced95a715067"
format_stamp: "Formatted at 2026-08-07 20:17:51 on dist-test-slave-t7g5"
server_key: "353b4df5216b9184c40d57b03cd555d5"
server_key_iv: "13fa43312dd30c847ea6ced24ee3c288"
server_key_version: "encryptionkey@0"
I20260807 20:17:51.959064 8351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "e39e037a3a2f43a9baa7ced95a715067"
format_stamp: "Formatted at 2026-08-07 20:17:51 on dist-test-slave-t7g5"
server_key: "353b4df5216b9184c40d57b03cd555d5"
server_key_iv: "13fa43312dd30c847ea6ced24ee3c288"
server_key_version: "encryptionkey@0"
I20260807 20:17:51.960361 8351 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:51.961051 8379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:51.961221 8351 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:51.961320 8351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "e39e037a3a2f43a9baa7ced95a715067"
format_stamp: "Formatted at 2026-08-07 20:17:51 on dist-test-slave-t7g5"
server_key: "353b4df5216b9184c40d57b03cd555d5"
server_key_iv: "13fa43312dd30c847ea6ced24ee3c288"
server_key_version: "encryptionkey@0"
I20260807 20:17:51.961383 8351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:51.971726 8351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:51.973551 8351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:51.973737 8351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:51.977624 8351 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:34587
I20260807 20:17:51.977694 8502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:34587 every 8 connection(s)
I20260807 20:17:51.978035 8351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:51.978996 8503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:51.981218 8503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067: Bootstrap starting.
I20260807 20:17:51.981803 8503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:51.982048 8503 log.cc:824] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:51.982651 8503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067: No bootstrap required, opened a new log
I20260807 20:17:51.983160 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 8351
I20260807 20:17:51.983253 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:51.983417 30863 external_mini_cluster.cc:1428] Setting key 1f1167df0b41bbaeee277d9a16ff7fff
I20260807 20:17:51.984545 8503 raft_consensus.cc:348] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } }
I20260807 20:17:51.984719 8503 raft_consensus.cc:374] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:51.984755 8503 raft_consensus.cc:729] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39e037a3a2f43a9baa7ced95a715067, State: Initialized, Role: FOLLOWER
I20260807 20:17:51.984937 8503 consensus_queue.cc:260] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } }
I20260807 20:17:51.985024 8503 raft_consensus.cc:388] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:51.985046 8503 raft_consensus.cc:482] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:51.985093 8503 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:51.986234 8503 raft_consensus.cc:504] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } }
I20260807 20:17:51.986344 8503 leader_election.cc:302] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e39e037a3a2f43a9baa7ced95a715067; no voters:
I20260807 20:17:51.986490 8503 leader_election.cc:288] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:51.986529 8509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:51.986707 8509 raft_consensus.cc:686] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [term 1 LEADER]: Becoming Leader. State: Replica: e39e037a3a2f43a9baa7ced95a715067, State: Running, Role: LEADER
I20260807 20:17:51.986706 8503 sys_catalog.cc:564] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:51.987469 8509 consensus_queue.cc:237] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } }
I20260807 20:17:51.987998 8511 sys_catalog.cc:455] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e39e037a3a2f43a9baa7ced95a715067. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } }
I20260807 20:17:51.988134 8514 sys_catalog.cc:455] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } }
I20260807 20:17:51.988348 8511 sys_catalog.cc:458] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:51.988359 8514 sys_catalog.cc:458] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:51.988554 8544 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:51.989079 8544 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 20:17:51 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
I20260807 20:17:51.990716 8544 catalog_manager.cc:1347] Generated new cluster ID: 49e61e9f17cd4f238964dafa3b62a1f1
I20260807 20:17:51.990760 8544 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:17:51.995002 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:51.983910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54230 (local address 127.30.35.254:34587)
0807 20:17:51.984141 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:51.984151 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:51.984186 (+ 35us) server_negotiation.cc:407] Connection header received
0807 20:17:51.984517 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:51.984525 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:51.984588 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:51.984744 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:51.985417 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:51.986788 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:51.987723 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:51.988333 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:51.988451 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:51.991197 (+ 2746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:51.991201 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:51.991201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:51.991212 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:51.993087 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:51.993461 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:51.993464 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:51.993464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:51.993586 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:51.993779 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:51.993780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:51.993780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:51.994063 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:51.994198 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:51.994667 (+ 469us) server_negotiation.cc:299] Negotiation successful
0807 20:17:51.994804 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":92,"threads_started":1}
I20260807 20:17:52.004989 8544 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:52.005496 8544 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:52.009536 8544 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067: Generated new TSK 0
I20260807 20:17:52.009763 8544 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.193.keytab.
Entry for principal oryx/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.193.keytab.
I20260807 20:17:52.037274 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34587
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.193.keytab
--principal=oryx/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:52.117481 8552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:52.117703 8552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:52.117727 8552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:52.118849 8552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:52.118893 8552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:52.118918 8552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:17:52.120352 8552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.193.keytab
--principal=oryx/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:52.120590 8552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:52.120802 8552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:52.125630 8564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:52.125698 8552 server_base.cc:1034] running on GCE node
W20260807 20:17:52.125712 8559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:52.125670 8561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:52.126042 8552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:52.126276 8552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:52.127414 8552 hybrid_clock.cc:648] HybridClock initialized: now 1786133872127396 us; error 35 us; skew 500 ppm
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133872, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:52.129930 8552 init.cc:377] Logged in from keytab as oryx/127.30.35.193@KRBTEST.COM (short username oryx)
I20260807 20:17:52.130345 8552 webserver.cc:460] Webserver started at http://127.30.35.193:44859/ using document root <none> and password file <none>
I20260807 20:17:52.130548 8552 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:52.130589 8552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:52.130676 8552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:52.131645 8552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "3133b441314a4fbd91f4a74723f58cd5"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "8ab26086b3e507c28831f9af32b48427"
server_key_iv: "44168c0218e7b4e4662cb9ffda235e8b"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.131968 8552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "3133b441314a4fbd91f4a74723f58cd5"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "8ab26086b3e507c28831f9af32b48427"
server_key_iv: "44168c0218e7b4e4662cb9ffda235e8b"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.133102 8552 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 20:17:52.133790 8576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:52.133945 8552 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:52.134029 8552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "3133b441314a4fbd91f4a74723f58cd5"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "8ab26086b3e507c28831f9af32b48427"
server_key_iv: "44168c0218e7b4e4662cb9ffda235e8b"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.134090 8552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:52.158383 8552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:52.160166 8552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:52.160300 8552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:52.160511 8552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:52.160800 8552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:52.160835 8552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:52.160863 8552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:52.160885 8552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:52.166425 8552 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:44223
I20260807 20:17:52.166489 8783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:44223 every 8 connection(s)
I20260807 20:17:52.166761 8552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:17:52.172343 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 8552
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133872, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
I20260807 20:17:52.172448 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:17:52.172631 30863 external_mini_cluster.cc:1428] Setting key a0984aac99cf2de8a21bd385189eae0d
I20260807 20:17:52.175745 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.167358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:49549 (local address 127.30.35.254:34587)
0807 20:17:52.167399 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.167401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.167587 (+ 186us) server_negotiation.cc:407] Connection header received
0807 20:17:52.168079 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.168080 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.168098 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.168150 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.169070 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.169574 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.170557 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.170782 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.170839 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.172906 (+ 2067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.172908 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.172908 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.172917 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.174431 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.174803 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.174804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.174805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.174872 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.175144 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.175145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.175145 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.175245 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.175294 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.175605 (+ 311us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.175680 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 20:17:52.175956 8789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.167339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.193:49549)
0807 20:17:52.167475 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.167510 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.167983 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.168220 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.168223 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:52.168760 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:52.168970 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.168976 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.169685 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.169686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.170475 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.170478 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.170853 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.170854 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.170974 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.171375 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:52.171383 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:52.172835 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:52.174519 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.174527 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.174528 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.174743 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.174937 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.174938 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.174938 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.175085 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.175308 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:52.175313 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:52.175481 (+ 168us) client_negotiation.cc:769] Sending connection context
0807 20:17:52.175591 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 20:17:52.175747 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":71,"threads_started":1}
I20260807 20:17:52.176455 8784 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34587
I20260807 20:17:52.176548 8784 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:52.176713 8784 heartbeater.cc:511] Master 127.30.35.254:34587 requested a full tablet report, sending...
I20260807 20:17:52.177219 8417 ts_manager.cc:194] Registered new tserver with Master: 3133b441314a4fbd91f4a74723f58cd5 (127.30.35.193:44223)
I20260807 20:17:52.177892 8417 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:49549
WARNING: no policy specified for oryx/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.194.keytab.
Entry for principal oryx/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.194.keytab.
I20260807 20:17:52.197741 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34587
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.194.keytab
--principal=oryx/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:52.278354 8794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:52.278568 8794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:52.278599 8794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:52.279721 8794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:52.279762 8794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:52.279798 8794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:17:52.281217 8794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.194.keytab
--principal=oryx/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:52.281462 8794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:52.281704 8794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:52.286569 8808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:52.286526 8803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:52.286535 8802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:52.286819 8794 server_base.cc:1034] running on GCE node
I20260807 20:17:52.287041 8794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:52.287261 8794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:52.288401 8794 hybrid_clock.cc:648] HybridClock initialized: now 1786133872288391 us; error 32 us; skew 500 ppm
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133872, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:52.290773 8794 init.cc:377] Logged in from keytab as oryx/127.30.35.194@KRBTEST.COM (short username oryx)
I20260807 20:17:52.291215 8794 webserver.cc:460] Webserver started at http://127.30.35.194:34301/ using document root <none> and password file <none>
I20260807 20:17:52.291425 8794 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:52.291473 8794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:52.291599 8794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:52.292620 8794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "c33dc8adf30347d0851a35e14eab6d25"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "1e510008340ce5993c5c290ada0c3c3c"
server_key_iv: "e3db256e0ac5003ab62cbace8439fc85"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.292965 8794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "c33dc8adf30347d0851a35e14eab6d25"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "1e510008340ce5993c5c290ada0c3c3c"
server_key_iv: "e3db256e0ac5003ab62cbace8439fc85"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.294305 8794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:17:52.294972 8817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:52.295115 8794 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:52.295212 8794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "c33dc8adf30347d0851a35e14eab6d25"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "1e510008340ce5993c5c290ada0c3c3c"
server_key_iv: "e3db256e0ac5003ab62cbace8439fc85"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.295279 8794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:52.313174 8794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:52.315240 8794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:52.315366 8794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:52.315616 8794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:52.315922 8794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:52.315958 8794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:52.315980 8794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:52.316002 8794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:52.321550 8794 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:33857
I20260807 20:17:52.321591 9013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:33857 every 8 connection(s)
I20260807 20:17:52.321940 8794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:17:52.322075 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 8794
I20260807 20:17:52.322175 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:17:52.322376 30863 external_mini_cluster.cc:1428] Setting key 347b2a221e26cfb316760320f0261616
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133872, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.30.35.195@KRBTEST.COM; defaulting to no policy
I20260807 20:17:52.331777 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.322674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:47807 (local address 127.30.35.254:34587)
0807 20:17:52.322728 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.322730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.323071 (+ 341us) server_negotiation.cc:407] Connection header received
0807 20:17:52.323683 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.323684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.323695 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.323729 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.324923 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.325792 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.326757 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.326970 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.327034 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.329184 (+ 2150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.329186 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.329186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.329194 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.330521 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.330888 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.330890 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.330890 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.330951 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.331172 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.331173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.331173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.331287 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.331341 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.331598 (+ 257us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.331686 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:17:52.331950 9019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.322650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.194:47807)
0807 20:17:52.322941 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.322990 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.323588 (+ 598us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.323817 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.323821 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:52.324544 (+ 723us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:52.324830 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.324838 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.325878 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.325879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.326685 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.326687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.327054 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.327055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.327184 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.327651 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:52.327660 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:52.329097 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:52.330595 (+ 1498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.330603 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.330605 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.330822 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.331004 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.331005 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.331005 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.331119 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.331340 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:52.331347 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:52.331483 (+ 136us) client_negotiation.cc:769] Sending connection context
0807 20:17:52.331571 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 20:17:52.331730 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":84,"threads_started":1}
I20260807 20:17:52.332399 9014 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34587
I20260807 20:17:52.332494 9014 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:52.332669 9014 heartbeater.cc:511] Master 127.30.35.254:34587 requested a full tablet report, sending...
I20260807 20:17:52.333027 8417 ts_manager.cc:194] Registered new tserver with Master: c33dc8adf30347d0851a35e14eab6d25 (127.30.35.194:33857)
I20260807 20:17:52.333375 8417 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:47807
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.195.keytab.
Entry for principal oryx/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.195.keytab.
I20260807 20:17:52.347626 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34587
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.195.keytab
--principal=oryx/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:52.427599 9023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:52.427785 9023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:52.427806 9023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:52.428898 9023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:52.428946 9023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:52.428974 9023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:17:52.430387 9023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.195.keytab
--principal=oryx/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34587
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:52.430596 9023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:52.430789 9023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:52.435384 9032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:52.435392 9034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:52.435580 9023 server_base.cc:1034] running on GCE node
W20260807 20:17:52.435384 9039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:52.435825 9023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:52.436053 9023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:52.437215 9023 hybrid_clock.cc:648] HybridClock initialized: now 1786133872437204 us; error 38 us; skew 500 ppm
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133872, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:52.439646 9023 init.cc:377] Logged in from keytab as oryx/127.30.35.195@KRBTEST.COM (short username oryx)
I20260807 20:17:52.440124 9023 webserver.cc:460] Webserver started at http://127.30.35.195:44437/ using document root <none> and password file <none>
I20260807 20:17:52.440349 9023 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:52.440397 9023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:52.440536 9023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:52.441536 9023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "8cc5e1d582b547908b99986dee2b2a94"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "2d01f7ff141d4115ec0301b50ee4661d"
server_key_iv: "ed807b66c7ff506a395f35e3e52f5497"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.441915 9023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "8cc5e1d582b547908b99986dee2b2a94"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "2d01f7ff141d4115ec0301b50ee4661d"
server_key_iv: "ed807b66c7ff506a395f35e3e52f5497"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.443115 9023 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:52.443768 9053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:52.443918 9023 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:52.444000 9023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "8cc5e1d582b547908b99986dee2b2a94"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "2d01f7ff141d4115ec0301b50ee4661d"
server_key_iv: "ed807b66c7ff506a395f35e3e52f5497"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.444067 9023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:52.467483 9023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:52.469573 9023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:52.469738 9023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:52.469959 9023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:52.470249 9023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:52.470283 9023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:52.470312 9023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:52.470336 9023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:52.475795 9023 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:40203
I20260807 20:17:52.475832 9255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:40203 every 8 connection(s)
I20260807 20:17:52.476133 9023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133872, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
I20260807 20:17:52.482620 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 9023
I20260807 20:17:52.482724 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:17:52.482936 30863 external_mini_cluster.cc:1428] Setting key 072bddd53e376b3fc6292b9f24ce4c37
I20260807 20:17:52.484974 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.476787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:58553 (local address 127.30.35.254:34587)
0807 20:17:52.476842 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.476844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.477028 (+ 184us) server_negotiation.cc:407] Connection header received
0807 20:17:52.477533 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.477534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.477547 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.477600 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.478537 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.479040 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.479997 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.480186 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.480240 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.482196 (+ 1956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.482198 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.482198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.482205 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.483756 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.484108 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.484109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.484109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.484171 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.484382 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.484383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.484383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.484502 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.484558 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.484810 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.484886 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 20:17:52.485145 9259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.476747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.195:58553)
0807 20:17:52.476914 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.476950 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.477436 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.477695 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.477699 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:52.478243 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:52.478440 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.478444 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.479121 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.479122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.479910 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.479912 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.480252 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.480253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.480371 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.480780 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:52.480788 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:52.482114 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:52.483814 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.483822 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.483824 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.484042 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.484224 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.484224 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.484225 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.484328 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.484558 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:52.484565 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:52.484693 (+ 128us) client_negotiation.cc:769] Sending connection context
0807 20:17:52.484780 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 20:17:52.484942 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260807 20:17:52.485517 9256 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34587
I20260807 20:17:52.485603 9256 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:52.485796 9256 heartbeater.cc:511] Master 127.30.35.254:34587 requested a full tablet report, sending...
I20260807 20:17:52.486120 8417 ts_manager.cc:194] Registered new tserver with Master: 8cc5e1d582b547908b99986dee2b2a94 (127.30.35.195:40203)
I20260807 20:17:52.486478 8417 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:58553
I20260807 20:17:52.494524 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.30.35.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.35.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.35.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.253.keytab.
Entry for principal oryx/127.30.35.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.253.keytab.
I20260807 20:17:52.518497 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.253:45139
--webserver_interface=127.30.35.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.253.keytab
--principal=oryx/127.30.35.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:34587,127.30.35.253:45139
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:52.599081 9263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:52.599296 9263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:52.599318 9263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:52.600421 9263 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:52.600461 9263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:52.600474 9263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:52.600497 9263 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:52.600520 9263 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:52.601953 9263 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:34587,127.30.35.253:45139
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.253.keytab
--principal=oryx/127.30.35.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.253:45139
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.35.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
W20260807 20:17:52.602054 9263 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.30.35.254:34587,127.30.35.253:45139'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 20:17:52.602192 9263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:52.602385 9263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:52.606935 9277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:52.606910 9284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:52.606938 9263 server_base.cc:1034] running on GCE node
W20260807 20:17:52.606921 9278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:52.607379 9263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:52.607645 9263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:52.608777 9263 hybrid_clock.cc:648] HybridClock initialized: now 1786133872608764 us; error 29 us; skew 500 ppm
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133872, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:52.611136 9263 init.cc:377] Logged in from keytab as oryx/127.30.35.253@KRBTEST.COM (short username oryx)
I20260807 20:17:52.611541 9263 webserver.cc:460] Webserver started at http://127.30.35.253:37299/ using document root <none> and password file <none>
I20260807 20:17:52.611756 9263 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:52.611804 9263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:52.611927 9263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:52.612923 9263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/data/instance:
uuid: "5550be937dfa46f6a4689be4050430c6"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "cd4100a827d8978e86ba6a5ce1e9e96d"
server_key_iv: "b7c94831884d379437e1a769a38d1ed7"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.613276 9263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/wal/instance:
uuid: "5550be937dfa46f6a4689be4050430c6"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "cd4100a827d8978e86ba6a5ce1e9e96d"
server_key_iv: "b7c94831884d379437e1a769a38d1ed7"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.614568 9263 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:17:52.615190 9292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:52.615345 9263 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:17:52.615427 9263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/wal
uuid: "5550be937dfa46f6a4689be4050430c6"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "cd4100a827d8978e86ba6a5ce1e9e96d"
server_key_iv: "b7c94831884d379437e1a769a38d1ed7"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.615490 9263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:52.643777 9263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:52.645505 9263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:52.645613 9263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:52.649343 9263 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.253:45139
I20260807 20:17:52.649390 9375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.253:45139 every 8 connection(s)
I20260807 20:17:52.649721 9263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/data/info.pb
I20260807 20:17:52.650707 9376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:52.652220 9376 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:17:52.653630 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 9263
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133872, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.253@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.35.253@KRBTEST.COM
I20260807 20:17:52.661201 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.652895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54242 (local address 127.30.35.254:34587)
0807 20:17:52.652942 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.652944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.653137 (+ 193us) server_negotiation.cc:407] Connection header received
0807 20:17:52.653614 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.653616 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.653630 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.653714 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.654527 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.655043 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.655979 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.656171 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.656220 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.658494 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.658495 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.658496 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.658502 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.659794 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.660204 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.660205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.660206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.660268 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.660534 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.660535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.660535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.660736 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.660810 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.661030 (+ 220us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.661105 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:17:52.661296 9381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.652869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.0.0.1:54242)
0807 20:17:52.653022 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.653056 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.653513 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.653908 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.653913 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:52.654169 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:52.654442 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.654448 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.655139 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.655139 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.655899 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.655901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.656239 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.656240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.656375 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.656848 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:52.656856 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:52.658414 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:52.659854 (+ 1440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.659860 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.659862 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.660140 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.660333 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.660334 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.660334 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.660473 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.660799 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:52.660803 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:52.660907 (+ 104us) client_negotiation.cc:769] Sending connection context
0807 20:17:52.660987 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 20:17:52.661128 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":88,"threads_started":1}
I20260807 20:17:52.661996 9376 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:17:52.662482 9384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.654227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44316 (local address 127.30.35.253:45139)
0807 20:17:52.654393 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.654398 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.654429 (+ 31us) server_negotiation.cc:407] Connection header received
0807 20:17:52.654449 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.654451 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.654470 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.654539 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.655100 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.655889 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.656737 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.657056 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.657106 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.659593 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.659600 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.659600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.659605 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.661237 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.661624 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.661626 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.661627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.661707 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.661902 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.661902 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.661903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.662057 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.662199 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.662316 (+ 117us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.662389 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":95,"threads_started":1}
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133872, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.253@KRBTEST.COM for oryx/127.30.35.253@KRBTEST.COM
I20260807 20:17:52.668403 9381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.662235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:45139 (local address 127.0.0.1:44318)
0807 20:17:52.662365 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.662374 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.662406 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.662626 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.662627 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:52.662760 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:52.662809 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.662811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.663507 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.663508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.664036 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.664038 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.664343 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.664343 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.664387 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.664656 (+ 269us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:52.664660 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:52.665735 (+ 1075us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:52.667560 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.667561 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.667561 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.667709 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.667862 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.667863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.667863 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.667922 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.668108 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:52.668109 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:52.668145 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 20:17:52.668204 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 20:17:52.668293 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260807 20:17:52.668483 9385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.662265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44318 (local address 127.30.35.253:45139)
0807 20:17:52.662392 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.662394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.662401 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:17:52.662450 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.662451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.662460 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.662527 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.662902 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.663447 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.664097 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.664291 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.664341 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.665798 (+ 1457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.665799 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.665800 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.665806 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.667490 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.667764 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.667765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.667765 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.667814 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.667969 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.667970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.667970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.668059 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.668110 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.668228 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.668340 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":109,"thread_start_us":73,"threads_started":1}
I20260807 20:17:52.669598 9376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: Bootstrap starting.
I20260807 20:17:52.670203 9376 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:52.670426 9376 log.cc:824] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:52.671049 9376 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: No bootstrap required, opened a new log
I20260807 20:17:52.672329 9376 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } }
I20260807 20:17:52.672513 9376 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:52.672585 9376 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5550be937dfa46f6a4689be4050430c6, State: Initialized, Role: FOLLOWER
I20260807 20:17:52.672734 9376 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } }
I20260807 20:17:52.672995 9376 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:52.672971 9392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } } }
I20260807 20:17:52.673054 9392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 20:17:52.674537 9420 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:17:52.674598 9420 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:17:52.676252 9263 master_runner.cc:428] Detected that this master 5550be937dfa46f6a4689be4050430c6 is joining an existing cluster
I20260807 20:17:52.676316 9263 master_runner.cc:432] Initiating AddMaster RPC to add 127.30.35.253:45139
I20260807 20:17:52.683282 9385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.677337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44322 (local address 127.30.35.253:45139)
0807 20:17:52.677370 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.677372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.677473 (+ 101us) server_negotiation.cc:407] Connection header received
0807 20:17:52.677546 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.677546 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.677554 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.677577 (+ 23us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.678044 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.678508 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.679322 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.679638 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.679670 (+ 32us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.680735 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.680736 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.680737 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.680743 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.682146 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.682425 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.682427 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.682427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.682477 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.682681 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.682682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.682683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.682822 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.682903 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.683041 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.683176 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":16}
I20260807 20:17:52.683395 9430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.677224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:45139 (local address 127.0.0.1:44322)
0807 20:17:52.677413 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.677430 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.677489 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.677621 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.677622 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:52.677895 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:52.677967 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.677970 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.678562 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.678562 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.679244 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.679246 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.679744 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.679745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.679795 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.680179 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:52.680184 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:52.680652 (+ 468us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:52.682217 (+ 1565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.682218 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.682218 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.682371 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.682536 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.682536 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.682536 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.682612 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.682900 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:52.682901 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:52.682944 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 20:17:52.683012 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 20:17:52.683110 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":80,"threads_started":1}
I20260807 20:17:52.683609 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.677291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54256 (local address 127.30.35.254:34587)
0807 20:17:52.677342 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.677344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.677491 (+ 147us) server_negotiation.cc:407] Connection header received
0807 20:17:52.677539 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.677541 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.677553 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.677612 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.678039 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.678785 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.679702 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.680009 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.680079 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.680949 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.680950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.680951 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.680958 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.682453 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.682794 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.682795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.682796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.682855 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.683056 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.683058 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.683058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.683184 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.683229 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.683443 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.683530 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 20:17:52.683897 9431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.677211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.0.0.1:54256)
0807 20:17:52.677414 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.677424 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.677484 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.677612 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.677613 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:52.677890 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:52.677968 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.677970 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.678869 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.678870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.679627 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.679628 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.680098 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.680099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.680158 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.680466 (+ 308us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:52.680470 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:52.680866 (+ 396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:52.682528 (+ 1662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.682529 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.682529 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.682735 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.682926 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.682927 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.682928 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.682985 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.683278 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:52.683279 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:52.683328 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 20:17:52.683707 (+ 379us) client_negotiation.cc:240] Negotiation successful
0807 20:17:52.683804 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":4,"thread_start_us":149,"threads_started":1}
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133871, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.254@KRBTEST.COM for oryx/127.30.35.253@KRBTEST.COM
I20260807 20:17:52.692723 9385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.685887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44326 (local address 127.30.35.253:45139)
0807 20:17:52.685924 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.685926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.686032 (+ 106us) server_negotiation.cc:407] Connection header received
0807 20:17:52.686123 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.686124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.686131 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.686171 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.686685 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.687169 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.688271 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.688449 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.688529 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.690578 (+ 2049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.690580 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.690580 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.690586 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.691723 (+ 1137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.692128 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.692129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.692129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.692171 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.692321 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.692321 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.692322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.692402 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.692452 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.692616 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.692668 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:17:52.692822 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.685816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:45139 (local address 127.0.0.1:44326)
0807 20:17:52.685935 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.685982 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.686055 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.686177 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.686180 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:52.686507 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:52.686572 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.686574 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.687233 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.687234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.688200 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.688204 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.688532 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.688533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.688612 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.688972 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:52.688977 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:52.690500 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:52.691780 (+ 1280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.691788 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.691790 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.692057 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.692207 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.692208 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.692208 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.692273 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.692459 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:52.692465 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:52.692516 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 20:17:52.692601 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 20:17:52.692718 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":63,"threads_started":1}
I20260807 20:17:52.693382 8417 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.30.35.253:45139: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "5550be937dfa46f6a4689be4050430c6"
member_type: NON_VOTER
last_known_addr {
host: "127.30.35.253"
port: 45139
}
attrs {
promote: true
}
}
dest_uuid: "e39e037a3a2f43a9baa7ced95a715067"
cas_config_opid_index: -1
I20260807 20:17:52.693840 8417 consensus_queue.cc:237] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: NON_VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: true } }
I20260807 20:17:52.694383 9435 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 5550be937dfa46f6a4689be4050430c6 (127.30.35.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: NON_VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: true } } }
I20260807 20:17:52.694649 9338 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:52.695451 9435 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.30.35.253:45139
I20260807 20:17:52.695482 9338 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 FOLLOWER]: Refusing update from remote peer e39e037a3a2f43a9baa7ced95a715067: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 20:17:52.695554 9435 sys_catalog.cc:455] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: NON_VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: true } } }
I20260807 20:17:52.695616 9435 sys_catalog.cc:458] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:52.695778 9263 master.cc:537] Master@127.30.35.253:45139 shutting down...
I20260807 20:17:52.695782 9434 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: NON_VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 20:17:52.696538 8380 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260807 20:17:52.697049 8380 consensus_peers.cc:487] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 -> Peer 5550be937dfa46f6a4689be4050430c6 (127.30.35.253:45139): Couldn't send request to peer 5550be937dfa46f6a4689be4050430c6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 20:17:52.698501 9263 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:52.698575 9263 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:52.698621 9263 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: stopping tablet replica
I20260807 20:17:52.711378 9263 master.cc:552] Master@127.30.35.253:45139 shutdown complete.
I20260807 20:17:52.711436 9263 master_runner.cc:305] Clearing existing system tablet
I20260807 20:17:52.711551 9263 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:52.711599 9263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:52.712145 9263 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.001s
I20260807 20:17:52.712570 9447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:52.712692 9263 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:52.712771 9263 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:52.712798 9263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/wal
uuid: "5550be937dfa46f6a4689be4050430c6"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "cd4100a827d8978e86ba6a5ce1e9e96d"
server_key_iv: "b7c94831884d379437e1a769a38d1ed7"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.713814 9263 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:52.715269 9263 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 20:17:52.715341 9263 log.cc:1196] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 20:17:52.715550 9263 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: Deleting consensus metadata
I20260807 20:17:52.715665 9263 master_runner.cc:315] Copying system tablet from 127.30.35.254:34587
I20260807 20:17:52.716284 9263 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: tablet copy: Beginning tablet copy session from remote peer at address 127.30.35.254:34587
I20260807 20:17:52.722306 9463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.716547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.0.0.1:54272)
0807 20:17:52.716668 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.716678 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.716735 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.716880 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.716881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:52.717039 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:52.717097 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.717098 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.718072 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.718072 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.718603 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.718604 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.719053 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.719053 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.719095 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.719532 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:52.719535 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:52.719812 (+ 277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:52.721403 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.721404 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.721404 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.721576 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.721780 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.721780 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.721781 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.721831 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.722069 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:52.722070 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:52.722108 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 20:17:52.722165 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 20:17:52.722239 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":68,"threads_started":1}
I20260807 20:17:52.722360 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.716624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54272 (local address 127.30.35.254:34587)
0807 20:17:52.716674 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.716676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.716726 (+ 50us) server_negotiation.cc:407] Connection header received
0807 20:17:52.716779 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.716780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.716791 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.716876 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.717156 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.718002 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.718677 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.718991 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.719059 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.719898 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.719900 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.719901 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.719909 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.721333 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.721638 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.721639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.721639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.721725 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.721886 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.721887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.721887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.722018 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.722090 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.722191 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.722267 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 20:17:52.722682 8471 tablet_copy_service.cc:140] P e39e037a3a2f43a9baa7ced95a715067: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 5550be937dfa46f6a4689be4050430c6 ({username='oryx', principal='oryx/127.30.35.253@KRBTEST.COM'} at 127.0.0.1:54272)
I20260807 20:17:52.722810 8471 tablet_copy_service.cc:161] P e39e037a3a2f43a9baa7ced95a715067: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 5550be937dfa46f6a4689be4050430c6 at {username='oryx', principal='oryx/127.30.35.253@KRBTEST.COM'} at 127.0.0.1:54272: session id = 5550be937dfa46f6a4689be4050430c6-00000000000000000000000000000000
I20260807 20:17:52.723517 8471 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 20:17:52.724124 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 20:17:52.725374 9263 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: tablet copy: Starting download of 0 data blocks...
I20260807 20:17:52.725512 9263 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: tablet copy: Starting download of 1 WAL segments...
I20260807 20:17:52.726434 9263 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 20:17:52.727313 8471 tablet_copy_service.cc:342] P e39e037a3a2f43a9baa7ced95a715067: Request end of tablet copy session 5550be937dfa46f6a4689be4050430c6-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.30.35.253@KRBTEST.COM'} at 127.0.0.1:54272
I20260807 20:17:52.727361 8471 tablet_copy_service.cc:433] P e39e037a3a2f43a9baa7ced95a715067: ending tablet copy session 5550be937dfa46f6a4689be4050430c6-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 5550be937dfa46f6a4689be4050430c6
I20260807 20:17:52.729830 9263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:52.730867 9464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:52.730880 9468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:52.731094 9474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:52.731240 9263 server_base.cc:1034] running on GCE node
I20260807 20:17:52.731333 9263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:52.731460 9263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:52.732584 9263 hybrid_clock.cc:648] HybridClock initialized: now 1786133872732575 us; error 21 us; skew 500 ppm
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133872, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:52.733856 9263 init.cc:377] Logged in from keytab as oryx/127.30.35.253@KRBTEST.COM (short username oryx)
I20260807 20:17:52.734115 9263 webserver.cc:460] Webserver started at http://127.30.35.253:43061/ using document root <none> and password file <none>
I20260807 20:17:52.734226 9263 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:52.734261 9263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:52.734891 9263 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:17:52.735391 9484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:52.735510 9263 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:17:52.735554 9263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/wal
uuid: "5550be937dfa46f6a4689be4050430c6"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "cd4100a827d8978e86ba6a5ce1e9e96d"
server_key_iv: "b7c94831884d379437e1a769a38d1ed7"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.735600 9263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:52.767237 9263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:52.768661 9263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:52.771034 9263 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.253:45139
I20260807 20:17:52.771405 9573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.253:45139 every 8 connection(s)
I20260807 20:17:52.771406 9263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-1/data/info.pb
I20260807 20:17:52.772383 9575 sys_catalog.cc:263] Verifying existing consensus state
I20260807 20:17:52.772913 9575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: Bootstrap starting.
I20260807 20:17:52.776021 9575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 20:17:52.776224 9575 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: Bootstrap complete.
I20260807 20:17:52.776412 9575 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: NON_VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: true } }
I20260807 20:17:52.776500 9575 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5550be937dfa46f6a4689be4050430c6, State: Initialized, Role: LEARNER
I20260807 20:17:52.776543 9575 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: NON_VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: true } }
I20260807 20:17:52.776708 9575 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:52.776707 9579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: NON_VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: true } } }
I20260807 20:17:52.776798 9579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: This master's current role is: LEARNER
I20260807 20:17:52.778191 9593 catalog_manager.cc:1259] Loaded cluster ID: 49e61e9f17cd4f238964dafa3b62a1f1
I20260807 20:17:52.778241 9593 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: loading cluster ID for follower catalog manager: success
I20260807 20:17:52.779181 9593 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: acquiring CA information for follower catalog manager: success
I20260807 20:17:52.779444 9593 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 20:17:52.819737 9595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.814515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44354 (local address 127.30.35.253:45139)
0807 20:17:52.814638 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.814640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.814648 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:52.814671 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.814672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.814681 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.814734 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.815250 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.815864 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.816504 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.816677 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.816717 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.817830 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.817830 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.817830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.817835 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.818936 (+ 1101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.819213 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.819213 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.819214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.819259 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.819383 (+ 124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.819384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.819384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.819478 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.819544 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.819609 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.819667 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":73,"threads_started":1}
WARNING: no policy specified for oryx/127.30.35.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.35.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.35.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.252.keytab.
Entry for principal oryx/127.30.35.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.252.keytab.
I20260807 20:17:52.842634 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.252:33809
--webserver_interface=127.30.35.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.252.keytab
--principal=oryx/127.30.35.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:34587,127.30.35.253:45139,127.30.35.252:33809
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:52.924530 9600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:52.924732 9600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:52.924753 9600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:52.925851 9600 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:52.925884 9600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:52.925897 9600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:52.925908 9600 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:52.925933 9600 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:52.927337 9600 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:34587,127.30.35.253:45139,127.30.35.252:33809
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.252.keytab
--principal=oryx/127.30.35.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.252:33809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.35.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9600
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:52.927527 9600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:52.927727 9600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:52.932317 9606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:52.932327 9610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:52.932375 9600 server_base.cc:1034] running on GCE node
W20260807 20:17:52.932327 9613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:52.932768 9600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:52.933048 9600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:52.934187 9600 hybrid_clock.cc:648] HybridClock initialized: now 1786133872934173 us; error 26 us; skew 500 ppm
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133872, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:52.936673 9600 init.cc:377] Logged in from keytab as oryx/127.30.35.252@KRBTEST.COM (short username oryx)
I20260807 20:17:52.937125 9600 webserver.cc:460] Webserver started at http://127.30.35.252:38799/ using document root <none> and password file <none>
I20260807 20:17:52.937319 9600 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:52.937367 9600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:52.937496 9600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:52.938524 9600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/data/instance:
uuid: "209b89c5016e4c37ab3cb8a018ff1aa8"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "854a602c17f16a699af8c99871426396"
server_key_iv: "85432329f911253717a900e6158603e3"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.938853 9600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/wal/instance:
uuid: "209b89c5016e4c37ab3cb8a018ff1aa8"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "854a602c17f16a699af8c99871426396"
server_key_iv: "85432329f911253717a900e6158603e3"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.940048 9600 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:52.940689 9624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:52.940832 9600 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:52.940914 9600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/wal
uuid: "209b89c5016e4c37ab3cb8a018ff1aa8"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "854a602c17f16a699af8c99871426396"
server_key_iv: "85432329f911253717a900e6158603e3"
server_key_version: "encryptionkey@0"
I20260807 20:17:52.940979 9600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:52.953385 9600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:52.955425 9600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:52.955570 9600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:52.959197 9600 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.252:33809
I20260807 20:17:52.959237 9724 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.252:33809 every 8 connection(s)
I20260807 20:17:52.959537 9600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/data/info.pb
I20260807 20:17:52.960429 9725 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:52.961862 9725 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133872, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.252@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
I20260807 20:17:52.967234 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 9600
I20260807 20:17:52.970346 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.962589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54282 (local address 127.30.35.254:34587)
0807 20:17:52.962647 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.962649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.962735 (+ 86us) server_negotiation.cc:407] Connection header received
0807 20:17:52.963203 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.963204 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.963217 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.963269 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.963885 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.964404 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.965373 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.965562 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.965616 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.967668 (+ 2052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.967670 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.967670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.967680 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.969048 (+ 1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.969465 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.969465 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.969465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.969511 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.969758 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.969758 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.969758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.969884 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.969951 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.970169 (+ 218us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.970251 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 20:17:52.970389 9730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.962454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.0.0.1:54282)
0807 20:17:52.962616 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.962662 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.963108 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.963343 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.963347 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:52.963614 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:52.963803 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.963808 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.964487 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.964488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.965286 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.965289 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.965643 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.965644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.965772 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.966162 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:52.966170 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:52.967579 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:52.969119 (+ 1540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.969124 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.969126 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.969400 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.969559 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.969559 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.969560 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.969700 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.969944 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:52.969948 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:52.970053 (+ 105us) client_negotiation.cc:769] Sending connection context
0807 20:17:52.970131 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 20:17:52.970243 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
I20260807 20:17:52.970893 9725 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.35.252@KRBTEST.COM
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133872, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.252@KRBTEST.COM for oryx/127.30.35.253@KRBTEST.COM
I20260807 20:17:52.976186 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.967844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32960 (local address 127.30.35.252:33809)
0807 20:17:52.968062 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.968065 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.968078 (+ 13us) server_negotiation.cc:407] Connection header received
0807 20:17:52.968094 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.968095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.968105 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.968155 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.968819 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.969726 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.970642 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.971045 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.971101 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.973295 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.973302 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.973303 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.973309 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.975074 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.975417 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.975420 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.975420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.975492 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.975658 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.975659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.975659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.975827 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.975959 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.976016 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.976085 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":81,"threads_started":1}
I20260807 20:17:52.977415 9730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.971124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:45139 (local address 127.0.0.1:44370)
0807 20:17:52.971201 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.971210 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.971243 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.971375 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.971376 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:52.971506 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:52.971557 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.971559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.972183 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.972183 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.972751 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.972753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.973215 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.973216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.973267 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.973577 (+ 310us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:52.973582 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:52.974940 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:52.976580 (+ 1640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.976581 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.976581 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.976790 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.976959 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.976960 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.976960 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.977025 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.977219 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:52.977220 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:52.977251 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 20:17:52.977296 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:17:52.977358 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 20:17:52.977452 9595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.971195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44370 (local address 127.30.35.253:45139)
0807 20:17:52.971235 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.971237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.971245 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:52.971301 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.971302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.971312 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.971367 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.971632 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.972094 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.972835 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.973144 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.973219 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.975047 (+ 1828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.975050 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.975050 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.975058 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.976478 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.976849 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.976851 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.976851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.976906 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.977063 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.977064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.977064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.977173 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.977221 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.977314 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.977380 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:17:52.977869 9725 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:17:52 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133872, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.252@KRBTEST.COM for oryx/127.30.35.252@KRBTEST.COM
I20260807 20:17:52.983595 9730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.978100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:33809 (local address 127.0.0.1:32974)
0807 20:17:52.978178 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.978188 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.978226 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.978355 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.978356 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:52.978457 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:52.978482 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.978483 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.979281 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.979282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.979714 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.979715 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.980110 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.980110 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.980242 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.980553 (+ 311us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:52.980557 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:52.981563 (+ 1006us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:52.982776 (+ 1213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.982777 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.982777 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.982925 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.983074 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:52.983074 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:52.983075 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:52.983126 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:52.983311 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:52.983312 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:52.983345 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 20:17:52.983404 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 20:17:52.983499 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 20:17:52.983647 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.978145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32974 (local address 127.30.35.252:33809)
0807 20:17:52.978274 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.978275 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.978280 (+ 5us) server_negotiation.cc:407] Connection header received
0807 20:17:52.978293 (+ 13us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.978293 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.978300 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.978341 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.978540 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.979217 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.979779 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.980045 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.980108 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.981631 (+ 1523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:52.981633 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:52.981633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:52.981639 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:52.982709 (+ 1070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.982980 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.982980 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.982981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.983026 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:52.983172 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:52.983172 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:52.983172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:52.983263 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:52.983313 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:52.983429 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 20:17:52.983547 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":119}
I20260807 20:17:52.984778 9725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: Bootstrap starting.
I20260807 20:17:52.985532 9725 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:52.985809 9725 log.cc:824] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:52.986502 9725 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: No bootstrap required, opened a new log
I20260807 20:17:52.988001 9725 raft_consensus.cc:348] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } }
I20260807 20:17:52.988121 9725 raft_consensus.cc:374] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:52.988162 9725 raft_consensus.cc:729] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 209b89c5016e4c37ab3cb8a018ff1aa8, State: Initialized, Role: FOLLOWER
I20260807 20:17:52.988277 9725 consensus_queue.cc:260] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } }
I20260807 20:17:52.988552 9725 sys_catalog.cc:564] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:52.988533 9736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } } }
I20260807 20:17:52.988664 9736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 20:17:52.990085 9753 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:17:52.990135 9753 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:17:52.992045 9600 master_runner.cc:428] Detected that this master 209b89c5016e4c37ab3cb8a018ff1aa8 is joining an existing cluster
I20260807 20:17:52.992084 9600 master_runner.cc:432] Initiating AddMaster RPC to add 127.30.35.252:33809
I20260807 20:17:53.013737 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.993021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54296 (local address 127.30.35.254:34587)
0807 20:17:52.993112 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.993114 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.993243 (+ 129us) server_negotiation.cc:407] Connection header received
0807 20:17:52.993266 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.993267 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.993278 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.993324 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.993820 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.994631 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.995379 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.995586 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.995638 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.010536 (+ 14898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.010537 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.010538 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.010546 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.012235 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.012836 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.012838 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.012838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.012905 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.013114 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.013115 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.013115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.013256 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.013302 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.013538 (+ 236us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.013621 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 20:17:53.013760 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.993202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32978 (local address 127.30.35.252:33809)
0807 20:17:52.993230 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.993231 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.993353 (+ 122us) server_negotiation.cc:407] Connection header received
0807 20:17:52.993429 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.993430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.993437 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.993459 (+ 22us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:52.993934 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.994587 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.995651 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.995927 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.995963 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.010496 (+ 14533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.010497 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.010498 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.010504 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.012592 (+ 2088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.012956 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.012956 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.012956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.013010 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.013183 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.013183 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.013184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.013298 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.013338 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.013501 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.013620 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 20:17:53.014076 9764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.993179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:33809 (local address 127.0.0.1:32978)
0807 20:17:52.993300 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.993309 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.993372 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.993504 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.993504 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:52.993799 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:52.993863 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.993866 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.994661 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.994662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.995562 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.995564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.996025 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.996026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.996078 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.996341 (+ 263us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:52.996345 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:53.010393 (+ 14048us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:53.012671 (+ 2278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.012672 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.012672 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.012881 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.013074 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.013074 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.013075 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.013125 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.013375 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:53.013376 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:53.013410 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.013533 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.013979 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"mutex_wait_us":45,"thread_start_us":67,"threads_started":1}
I20260807 20:17:53.014302 9766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.992955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.0.0.1:54296)
0807 20:17:52.993107 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.993118 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.993174 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.993366 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.993367 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:52.993631 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:52.993751 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.993753 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.994704 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.994705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.995304 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:52.995305 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:52.995655 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:52.995656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:52.995718 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:52.996065 (+ 347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:52.996070 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:53.010403 (+ 14333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:53.012330 (+ 1927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.012331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.012332 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.012767 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.012979 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.012979 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.012980 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.013046 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.013349 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:53.013350 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:53.013422 (+ 72us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.014013 (+ 591us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.014194 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":28,"thread_start_us":88,"threads_started":1}
I20260807 20:17:53.017448 9767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.992972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:45139 (local address 127.0.0.1:44386)
0807 20:17:52.993290 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:52.993298 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:52.993363 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:52.993520 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:52.993521 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.009948 (+ 16427us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:53.010044 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.010050 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.011021 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.011021 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.011851 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.011854 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.012390 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.012391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.012456 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.013441 (+ 985us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:53.013445 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:53.014282 (+ 837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:53.016218 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.016219 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.016219 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.016423 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.016737 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.016737 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.016738 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.016817 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.017130 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:53.017131 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:53.017173 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.017239 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.017335 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":88,"threads_started":1}
I20260807 20:17:53.017477 9595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:52.993019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44386 (local address 127.30.35.253:45139)
0807 20:17:52.993066 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:52.993067 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:52.993341 (+ 274us) server_negotiation.cc:407] Connection header received
0807 20:17:52.993425 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:52.993426 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:52.993436 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:52.993464 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.010186 (+ 16722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.010921 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.011971 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.012261 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.012307 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.014648 (+ 2341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.014650 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.014650 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.014659 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.016139 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.016489 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.016490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.016491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.016553 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.016887 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.016889 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.016889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.017033 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.017102 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.017287 (+ 185us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.017375 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Aug 07 20:17:53 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133871, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.254@KRBTEST.COM for oryx/127.30.35.252@KRBTEST.COM
I20260807 20:17:53.022619 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.016567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:33809 (local address 127.0.0.1:32980)
0807 20:17:53.016629 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.016639 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.016673 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.016830 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.016831 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.016976 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:53.017016 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.017017 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.017761 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.017762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.018360 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.018362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.018803 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.018804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.018857 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.019229 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:53.019234 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:53.020335 (+ 1101us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:53.021824 (+ 1489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.021825 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.021825 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.021983 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.022155 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.022156 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.022156 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.022200 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.022399 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:53.022400 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:53.022439 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.022482 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.022553 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 20:17:53.022660 9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.016617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32980 (local address 127.30.35.252:33809)
0807 20:17:53.016657 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.016658 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.016666 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:53.016729 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.016730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.016739 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.016782 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.017079 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.017681 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.018433 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.018730 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.018801 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.020408 (+ 1607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.020409 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.020410 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.020417 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.021758 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.022043 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.022043 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.022044 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.022099 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.022234 (+ 135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.022235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.022235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.022351 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.022412 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.022506 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.022573 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:17:53.023171 8417 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.30.35.252:33809: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8"
member_type: NON_VOTER
last_known_addr {
host: "127.30.35.252"
port: 33809
}
attrs {
promote: true
}
}
dest_uuid: "e39e037a3a2f43a9baa7ced95a715067"
cas_config_opid_index: 5
I20260807 20:17:53.023422 8417 consensus_queue.cc:237] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: NON_VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: true } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } }
I20260807 20:17:53.023759 9434 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 209b89c5016e4c37ab3cb8a018ff1aa8 (127.30.35.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: NON_VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: true } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } } }
I20260807 20:17:53.024045 9679 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:53.024797 9434 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.30.35.252:33809
I20260807 20:17:53.024883 9679 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 1 FOLLOWER]: Refusing update from remote peer e39e037a3a2f43a9baa7ced95a715067: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 20:17:53.024914 9435 sys_catalog.cc:455] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: NON_VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: true } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } } }
I20260807 20:17:53.024991 9435 sys_catalog.cc:458] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:53.025190 9600 master.cc:537] Master@127.30.35.252:33809 shutting down...
I20260807 20:17:53.025189 9435 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [LEADER]: Connected to new peer: Peer: permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 20:17:53.026191 8388 consensus_peers.cc:487] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 -> Peer 209b89c5016e4c37ab3cb8a018ff1aa8 (127.30.35.252:33809): Couldn't send request to peer 209b89c5016e4c37ab3cb8a018ff1aa8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 20:17:53.028647 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.023833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:45139 (local address 127.0.0.1:44400)
0807 20:17:53.023917 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.023926 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.023958 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.025481 (+ 1523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.025482 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.025484 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:53.025523 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.025525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.026464 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.026465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.027559 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.027562 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.028406 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.028407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.028477 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.028497 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.028544 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.028581 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 20:17:53.028656 9600 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:53.028748 9600 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:53.028797 9600 tablet_replica.cc:330] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: stopping tablet replica
I20260807 20:17:53.028889 9595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.025051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44400 (local address 127.30.35.253:45139)
0807 20:17:53.025242 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.025244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.025251 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:17:53.025272 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.025273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.025296 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.025357 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:53.025601 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.026367 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.027642 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.028223 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.028291 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.028372 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.028788 (+ 416us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.028825 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166}
I20260807 20:17:53.029125 9528 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 LEARNER]: Refusing update from remote peer e39e037a3a2f43a9baa7ced95a715067: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 20:17:53.029428 9435 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: NON_VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 20:17:53.030027 9528 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 209b89c5016e4c37ab3cb8a018ff1aa8 (127.30.35.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: NON_VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: true } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } } }
I20260807 20:17:53.031133 9770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: NON_VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: true } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } } }
I20260807 20:17:53.031282 9770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: This master's current role is: LEARNER
I20260807 20:17:53.032503 9579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e39e037a3a2f43a9baa7ced95a715067. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: NON_VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: true } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } } }
I20260807 20:17:53.032585 9579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: This master's current role is: LEARNER
I20260807 20:17:53.032815 9435 raft_consensus.cc:1050] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067: attempting to promote NON_VOTER 5550be937dfa46f6a4689be4050430c6 to VOTER
I20260807 20:17:53.033030 9435 consensus_queue.cc:237] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } }
I20260807 20:17:53.033581 9528 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 LEARNER]: Refusing update from remote peer e39e037a3a2f43a9baa7ced95a715067: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 20:17:53.033833 9434 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 20:17:53.034037 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.033931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:33809 (local address 127.0.0.1:32994)
0807 20:17:53.033972 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.034009 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:33809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260807 20:17:53.034448 9432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.034348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:33809 (local address 127.0.0.1:33004)
0807 20:17:53.034394 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.034424 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:33809: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 20:17:53.034516 8388 consensus_peers.cc:487] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 -> Peer 209b89c5016e4c37ab3cb8a018ff1aa8 (127.30.35.252:33809): Couldn't send request to peer 209b89c5016e4c37ab3cb8a018ff1aa8. Status: Network error: Client connection negotiation failed: client connection to 127.30.35.252:33809: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 20:17:53.034651 9435 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 5550be937dfa46f6a4689be4050430c6 (127.30.35.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } } }
I20260807 20:17:53.034874 9528 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 5550be937dfa46f6a4689be4050430c6 (127.30.35.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } } }
I20260807 20:17:53.035516 9435 sys_catalog.cc:455] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } } }
I20260807 20:17:53.035606 9435 sys_catalog.cc:458] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:53.035665 9435 sys_catalog.cc:455] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } } }
I20260807 20:17:53.035706 9435 sys_catalog.cc:458] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:53.035743 9579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } } }
I20260807 20:17:53.035813 9579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:17:53.042236 9600 master.cc:552] Master@127.30.35.252:33809 shutdown complete.
I20260807 20:17:53.042281 9600 master_runner.cc:305] Clearing existing system tablet
I20260807 20:17:53.042392 9600 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:53.042438 9600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:53.042989 9600 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:53.043414 9774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:53.043538 9600 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:53.043615 9600 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:53.043641 9600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/wal
uuid: "209b89c5016e4c37ab3cb8a018ff1aa8"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "854a602c17f16a699af8c99871426396"
server_key_iv: "85432329f911253717a900e6158603e3"
server_key_version: "encryptionkey@0"
I20260807 20:17:53.044400 9600 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:53.045787 9600 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 20:17:53.045861 9600 log.cc:1196] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 20:17:53.046056 9600 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: Deleting consensus metadata
I20260807 20:17:53.046181 9600 master_runner.cc:315] Copying system tablet from 127.30.35.254:34587
I20260807 20:17:53.046839 9600 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: tablet copy: Beginning tablet copy session from remote peer at address 127.30.35.254:34587
I20260807 20:17:53.052703 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.047182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54298 (local address 127.30.35.254:34587)
0807 20:17:53.047234 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.047235 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.047275 (+ 40us) server_negotiation.cc:407] Connection header received
0807 20:17:53.047328 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.047328 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.047339 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.047403 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.047811 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.048292 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.049290 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.049465 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.049505 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.050496 (+ 991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.050497 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.050497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.050504 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.051729 (+ 1225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.052084 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.052085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.052085 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.052136 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.052310 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.052310 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.052310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.052400 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.052455 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.052591 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.052645 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 20:17:53.052829 9786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.047113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.0.0.1:54298)
0807 20:17:53.047218 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.047229 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.047285 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.047451 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.047453 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.047661 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:53.047727 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.047729 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.048361 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.048362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.049223 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.049225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.049519 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.049520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.049589 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.050034 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:53.050039 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:53.050421 (+ 382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:53.051804 (+ 1383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.051805 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.051806 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.052020 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.052186 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.052187 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.052187 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.052254 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.052459 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:53.052459 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:53.052505 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.052571 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.052667 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":67,"threads_started":1}
I20260807 20:17:53.053047 8471 tablet_copy_service.cc:140] P e39e037a3a2f43a9baa7ced95a715067: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 209b89c5016e4c37ab3cb8a018ff1aa8 ({username='oryx', principal='oryx/127.30.35.252@KRBTEST.COM'} at 127.0.0.1:54298)
I20260807 20:17:53.053095 8471 tablet_copy_service.cc:161] P e39e037a3a2f43a9baa7ced95a715067: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 209b89c5016e4c37ab3cb8a018ff1aa8 at {username='oryx', principal='oryx/127.30.35.252@KRBTEST.COM'} at 127.0.0.1:54298: session id = 209b89c5016e4c37ab3cb8a018ff1aa8-00000000000000000000000000000000
I20260807 20:17:53.053499 8471 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 20:17:53.053936 9600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 20:17:53.054752 9600 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: tablet copy: Starting download of 0 data blocks...
I20260807 20:17:53.054879 9600 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: tablet copy: Starting download of 1 WAL segments...
I20260807 20:17:53.055583 9600 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 20:17:53.056291 8471 tablet_copy_service.cc:342] P e39e037a3a2f43a9baa7ced95a715067: Request end of tablet copy session 209b89c5016e4c37ab3cb8a018ff1aa8-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.30.35.252@KRBTEST.COM'} at 127.0.0.1:54298
I20260807 20:17:53.056339 8471 tablet_copy_service.cc:433] P e39e037a3a2f43a9baa7ced95a715067: ending tablet copy session 209b89c5016e4c37ab3cb8a018ff1aa8-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 209b89c5016e4c37ab3cb8a018ff1aa8
I20260807 20:17:53.058710 9600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:53.059792 9787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:53.059808 9790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:53.059973 9600 server_base.cc:1034] running on GCE node
W20260807 20:17:53.059851 9796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:53.060168 9600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:53.060300 9600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:53.061420 9600 hybrid_clock.cc:648] HybridClock initialized: now 1786133873061413 us; error 22 us; skew 500 ppm
Aug 07 20:17:53 dist-test-slave-t7g5 krb5kdc[8322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133873, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:53.062592 9600 init.cc:377] Logged in from keytab as oryx/127.30.35.252@KRBTEST.COM (short username oryx)
I20260807 20:17:53.062834 9600 webserver.cc:460] Webserver started at http://127.30.35.252:33083/ using document root <none> and password file <none>
I20260807 20:17:53.062942 9600 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:53.062976 9600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:53.063506 9600 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:53.063961 9807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:53.064054 9600 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:53.064096 9600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/wal
uuid: "209b89c5016e4c37ab3cb8a018ff1aa8"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "854a602c17f16a699af8c99871426396"
server_key_iv: "85432329f911253717a900e6158603e3"
server_key_version: "encryptionkey@0"
I20260807 20:17:53.064147 9600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:53.070345 9600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:53.071733 9600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:53.074512 9600 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.252:33809
I20260807 20:17:53.074651 9917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.252:33809 every 8 connection(s)
I20260807 20:17:53.074834 9600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/master-2/data/info.pb
I20260807 20:17:53.075498 9920 sys_catalog.cc:263] Verifying existing consensus state
I20260807 20:17:53.075891 9920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: Bootstrap starting.
I20260807 20:17:53.078383 9920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 20:17:53.078585 9920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: Bootstrap complete.
I20260807 20:17:53.078773 9920 raft_consensus.cc:348] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } }
I20260807 20:17:53.078843 9920 raft_consensus.cc:729] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 209b89c5016e4c37ab3cb8a018ff1aa8, State: Initialized, Role: LEARNER
I20260807 20:17:53.078871 9920 consensus_queue.cc:260] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } }
I20260807 20:17:53.079032 9920 sys_catalog.cc:564] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:53.079032 9925 sys_catalog.cc:455] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } } }
I20260807 20:17:53.079151 9925 sys_catalog.cc:458] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [sys.catalog]: This master's current role is: LEARNER
I20260807 20:17:53.080345 9941 catalog_manager.cc:1259] Loaded cluster ID: 49e61e9f17cd4f238964dafa3b62a1f1
I20260807 20:17:53.080382 9941 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: loading cluster ID for follower catalog manager: success
I20260807 20:17:53.081727 9941 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: acquiring CA information for follower catalog manager: success
I20260807 20:17:53.081997 9941 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 20:17:53.087845 9944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.081009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33018 (local address 127.30.35.252:33809)
0807 20:17:53.081100 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.081101 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.081109 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:53.081130 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.081130 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.081140 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.081197 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.081931 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.082605 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.083666 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.083884 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.083936 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.085291 (+ 1355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.085293 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.085293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.085300 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.086772 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.087104 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.087105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.087106 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.087171 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.087339 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.087340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.087340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.087474 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.087575 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.087652 (+ 77us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.087744 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75,"thread_start_us":58,"threads_started":1}
I20260807 20:17:53.088454 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 8552
I20260807 20:17:53.098573 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:44223
--local_ip_for_outbound_sockets=127.30.35.193
--tserver_master_addrs=127.30.35.254:34587
--webserver_port=44859
--webserver_interface=127.30.35.193
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.193.keytab
--principal=oryx/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.35.254:34587,127.30.35.253:45139
--tserver_master_addrs=127.30.35.254:34587,127.30.35.253:45139,127.30.35.252:33809 with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:53.179678 9946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:53.179913 9946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:53.179940 9946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:53.181094 9946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:53.181136 9946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:53.181161 9946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:17:53.182616 9946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.193.keytab
--principal=oryx/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:44223
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=44859
--tserver_master_addrs=127.30.35.254:34587,127.30.35.253:45139,127.30.35.252:33809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:53.182808 9946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:53.182988 9946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:53.187888 9960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:53.187988 9957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:53.188127 9946 server_base.cc:1034] running on GCE node
W20260807 20:17:53.187950 9962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:53.188382 9946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:53.188642 9946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:53.189787 9946 hybrid_clock.cc:648] HybridClock initialized: now 1786133873189777 us; error 29 us; skew 500 ppm
Aug 07 20:17:53 dist-test-slave-t7g5 krb5kdc[8322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133873, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:53.192169 9946 init.cc:377] Logged in from keytab as oryx/127.30.35.193@KRBTEST.COM (short username oryx)
I20260807 20:17:53.192581 9946 webserver.cc:460] Webserver started at http://127.30.35.193:44859/ using document root <none> and password file <none>
I20260807 20:17:53.192790 9946 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:53.192852 9946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:53.194226 9946 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:17:53.194800 9972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:53.194953 9946 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:17:53.195037 9946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "3133b441314a4fbd91f4a74723f58cd5"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "8ab26086b3e507c28831f9af32b48427"
server_key_iv: "44168c0218e7b4e4662cb9ffda235e8b"
server_key_version: "encryptionkey@0"
I20260807 20:17:53.195348 9946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:53.220311 9946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:53.222513 9946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:53.222652 9946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:53.222877 9946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:53.223187 9946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:53.223227 9946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:53.223256 9946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:53.223279 9946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:53.229032 9946 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:44223
I20260807 20:17:53.229094 10172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:44223 every 8 connection(s)
I20260807 20:17:53.229430 9946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:17:53.233989 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 9946
I20260807 20:17:53.234141 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 8794
Aug 07 20:17:53 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133873, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
Aug 07 20:17:53 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133873, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.252@KRBTEST.COM
I20260807 20:17:53.241878 9944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.230135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:56609 (local address 127.30.35.252:33809)
0807 20:17:53.230407 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.230410 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.230756 (+ 346us) server_negotiation.cc:407] Connection header received
0807 20:17:53.231518 (+ 762us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.231518 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.231531 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.231583 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.232376 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.233168 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.234283 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.234593 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.234629 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.237640 (+ 3011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.237641 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.237642 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.237669 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.240307 (+ 2638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.240726 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.240728 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.240728 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.240796 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.241086 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.241088 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.241088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.241228 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.241273 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.241683 (+ 410us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.241780 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236}
I20260807 20:17:53.242527 10181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.230140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:33809 (local address 127.30.35.193:56609)
0807 20:17:53.230687 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.230695 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.231431 (+ 736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.231670 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.231674 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.232040 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:53.232290 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.232295 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.233246 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.233246 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.234181 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.234183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.234707 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.234708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.234853 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.235480 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:53.235490 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:53.237553 (+ 2063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:53.240379 (+ 2826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.240387 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.240389 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.240615 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.240868 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.240868 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.240869 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.241004 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.241320 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:53.241327 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:53.241502 (+ 175us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.242090 (+ 588us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.242280 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":47,"thread_start_us":115,"threads_started":1}
I20260807 20:17:53.242672 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.230570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:57545 (local address 127.30.35.254:34587)
0807 20:17:53.230634 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.230636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.230862 (+ 226us) server_negotiation.cc:407] Connection header received
0807 20:17:53.231556 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.231557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.231570 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.231601 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.232403 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.232960 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.234283 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.234589 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.234629 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.237957 (+ 3328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.237958 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.237958 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.237966 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.241477 (+ 3511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.241870 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.241872 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.241872 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.241945 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.242149 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.242150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.242150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.242275 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.242326 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.242503 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.242583 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 20:17:53.242950 10183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.230449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.193:57545)
0807 20:17:53.230789 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.230796 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.231446 (+ 650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.231672 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.231675 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.232079 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:53.232290 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.232297 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.233063 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.233063 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.234181 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.234183 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.234707 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.234707 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.234890 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.235499 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:53.235503 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:53.237880 (+ 2377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:53.241572 (+ 3692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.241573 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.241573 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.241791 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.242020 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.242020 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.242021 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.242082 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.242358 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:53.242358 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:53.242398 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.242791 (+ 393us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.242876 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"mutex_wait_us":77,"thread_start_us":58,"threads_started":1}
I20260807 20:17:53.249248 10175 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34587
I20260807 20:17:53.249358 10175 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:53.249569 10175 heartbeater.cc:511] Master 127.30.35.254:34587 requested a full tablet report, sending...
Aug 07 20:17:53 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133873, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.253@KRBTEST.COM
I20260807 20:17:53.250018 8417 ts_manager.cc:194] Re-registered known tserver with Master: 3133b441314a4fbd91f4a74723f58cd5 (127.30.35.193:44223)
I20260807 20:17:53.250036 10173 heartbeater.cc:347] Connected to a master server at 127.30.35.252:33809
I20260807 20:17:53.250090 10173 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:53.250154 10173 heartbeater.cc:511] Master 127.30.35.252:33809 requested a full tablet report, sending...
I20260807 20:17:53.250496 8417 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:57545
I20260807 20:17:53.250523 9835 ts_manager.cc:194] Registered new tserver with Master: 3133b441314a4fbd91f4a74723f58cd5 (127.30.35.193:44223)
I20260807 20:17:53.253387 10180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.230140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:45139 (local address 127.30.35.193:49771)
0807 20:17:53.230327 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.230364 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.231431 (+ 1067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.231672 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.231675 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.232084 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:53.232290 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.232297 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.233278 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.233279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.234185 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.234189 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.234692 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.234693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.234852 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.235627 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:53.235633 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:53.250508 (+ 14875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:53.252411 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.252412 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.252413 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.252570 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.252740 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.252741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.252741 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.252793 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.253056 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:53.253057 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:53.253109 (+ 52us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.253177 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.253300 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":11,"thread_start_us":104,"threads_started":1}
I20260807 20:17:53.253391 9595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.230173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:49771 (local address 127.30.35.253:45139)
0807 20:17:53.230221 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.230223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.230452 (+ 229us) server_negotiation.cc:407] Connection header received
0807 20:17:53.231556 (+ 1104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.231558 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.231570 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.231601 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.232416 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.233168 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.234285 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.234565 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.234607 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.250718 (+ 16111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.250720 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.250721 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.250730 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.252324 (+ 1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.252633 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.252635 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.252635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.252686 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.252844 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.252845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.252845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.252968 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.253037 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.253215 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.253301 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 20:17:53.253489 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:33857
--local_ip_for_outbound_sockets=127.30.35.194
--tserver_master_addrs=127.30.35.254:34587
--webserver_port=34301
--webserver_interface=127.30.35.194
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.194.keytab
--principal=oryx/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.35.254:34587,127.30.35.253:45139
--tserver_master_addrs=127.30.35.254:34587,127.30.35.253:45139,127.30.35.252:33809 with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:17:53.253903 10177 heartbeater.cc:347] Connected to a master server at 127.30.35.253:45139
I20260807 20:17:53.253953 10177 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:53.254020 10177 heartbeater.cc:511] Master 127.30.35.253:45139 requested a full tablet report, sending...
I20260807 20:17:53.254396 9513 ts_manager.cc:194] Registered new tserver with Master: 3133b441314a4fbd91f4a74723f58cd5 (127.30.35.193:44223)
W20260807 20:17:53.336170 10184 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:53.336377 10184 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:53.336408 10184 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:53.337553 10184 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:53.337594 10184 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:53.337618 10184 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:17:53.339114 10184 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.194.keytab
--principal=oryx/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:33857
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=34301
--tserver_master_addrs=127.30.35.254:34587,127.30.35.253:45139,127.30.35.252:33809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10184
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:53.339313 10184 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:53.339490 10184 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:53.344276 10197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:53.344291 10193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:53.344446 10184 server_base.cc:1034] running on GCE node
W20260807 20:17:53.344291 10195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:53.344866 10184 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:53.345093 10184 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:53.346228 10184 hybrid_clock.cc:648] HybridClock initialized: now 1786133873346215 us; error 30 us; skew 500 ppm
Aug 07 20:17:53 dist-test-slave-t7g5 krb5kdc[8322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133873, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:53.348701 10184 init.cc:377] Logged in from keytab as oryx/127.30.35.194@KRBTEST.COM (short username oryx)
I20260807 20:17:53.349162 10184 webserver.cc:460] Webserver started at http://127.30.35.194:34301/ using document root <none> and password file <none>
I20260807 20:17:53.349376 10184 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:53.349442 10184 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:53.350739 10184 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:53.351269 10205 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:53.351418 10184 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:53.351498 10184 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "c33dc8adf30347d0851a35e14eab6d25"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "1e510008340ce5993c5c290ada0c3c3c"
server_key_iv: "e3db256e0ac5003ab62cbace8439fc85"
server_key_version: "encryptionkey@0"
I20260807 20:17:53.351816 10184 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:53.360991 10184 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:53.363020 10184 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:53.363150 10184 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:53.363384 10184 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:53.363662 10184 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:53.363695 10184 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:53.363721 10184 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:53.363746 10184 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:53.369508 10184 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:33857
I20260807 20:17:53.369546 10399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:33857 every 8 connection(s)
I20260807 20:17:53.369910 10184 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
Aug 07 20:17:53 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133873, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
Aug 07 20:17:53 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133873, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.252@KRBTEST.COM
Aug 07 20:17:53 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133873, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.253@KRBTEST.COM
I20260807 20:17:53.378654 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 10184
I20260807 20:17:53.378813 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 9023
I20260807 20:17:53.383071 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.370601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:52751 (local address 127.30.35.254:34587)
0807 20:17:53.370655 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.370657 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.370884 (+ 227us) server_negotiation.cc:407] Connection header received
0807 20:17:53.371929 (+ 1045us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.371930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.371943 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.371972 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.372784 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.373549 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.374616 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.374813 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.374868 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.377237 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.377238 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.377239 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.377245 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.379122 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.381709 (+ 2587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.381710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.381710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.381803 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.382160 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.382161 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.382161 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.382325 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.382378 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.382866 (+ 488us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.382966 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:17:53.383756 10414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.370578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.194:52751)
0807 20:17:53.370760 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.370800 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.371799 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.372058 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.372062 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.372468 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:53.372676 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.372682 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.373625 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.373626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.374510 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.374511 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.374873 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.374874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.374947 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.375542 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:53.375551 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:53.377136 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:53.381196 (+ 4060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.381205 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.381207 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.381575 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.381892 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.381893 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.381893 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.382058 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.382434 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:53.382443 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:53.382647 (+ 204us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.383223 (+ 576us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.383449 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":64,"thread_start_us":99,"threads_started":1}
I20260807 20:17:53.384279 10405 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34587
I20260807 20:17:53.384392 10405 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:53.384637 10405 heartbeater.cc:511] Master 127.30.35.254:34587 requested a full tablet report, sending...
I20260807 20:17:53.385080 8417 ts_manager.cc:194] Re-registered known tserver with Master: c33dc8adf30347d0851a35e14eab6d25 (127.30.35.194:33857)
I20260807 20:17:53.385695 8417 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:52751
I20260807 20:17:53.395061 9595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.370580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:59183 (local address 127.30.35.253:45139)
0807 20:17:53.370661 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.370663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.370903 (+ 240us) server_negotiation.cc:407] Connection header received
0807 20:17:53.371915 (+ 1012us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.371916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.371930 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.371985 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.372786 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.373576 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.374428 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.374659 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.374717 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.378134 (+ 3417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.378135 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.378135 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.378142 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.394025 (+ 15883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.394402 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.394403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.394404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.394458 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.394604 (+ 146us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.394604 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.394604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.394712 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.394745 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.394895 (+ 150us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.394969 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 20:17:53.395378 10413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.370578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:45139 (local address 127.30.35.194:59183)
0807 20:17:53.370833 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.370843 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.371804 (+ 961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.372058 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.372062 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.372463 (+ 401us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:53.372676 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.372682 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.373682 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.373683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.374336 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.374338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.374780 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.374782 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.374935 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.375632 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:53.375636 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:53.378056 (+ 2420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:53.394117 (+ 16061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.394118 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.394119 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.394329 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.394510 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.394511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.394511 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.394556 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.394778 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:53.394778 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:53.394814 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.395176 (+ 362us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.395288 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":43,"thread_start_us":93,"threads_started":1}
I20260807 20:17:53.395702 10406 heartbeater.cc:347] Connected to a master server at 127.30.35.253:45139
I20260807 20:17:53.395743 10406 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:53.395820 10406 heartbeater.cc:511] Master 127.30.35.253:45139 requested a full tablet report, sending...
I20260807 20:17:53.396162 9513 ts_manager.cc:194] Registered new tserver with Master: c33dc8adf30347d0851a35e14eab6d25 (127.30.35.194:33857)
I20260807 20:17:53.399458 9944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.370955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:59087 (local address 127.30.35.252:33809)
0807 20:17:53.370995 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.370997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.371031 (+ 34us) server_negotiation.cc:407] Connection header received
0807 20:17:53.371985 (+ 954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.371986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.371998 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.372049 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.372763 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.373259 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.374554 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.374828 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.374888 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.377704 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.377705 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.377705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.377714 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.379330 (+ 1616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.398657 (+ 19327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.398659 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.398659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.398728 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.398903 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.398904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.398904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.399017 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.399090 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.399261 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.399373 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:17:53.399549 10420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.370873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:33809 (local address 127.30.35.194:59087)
0807 20:17:53.370979 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.370987 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.371818 (+ 831us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.372063 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.372064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.372474 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:53.372675 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.372680 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.373360 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.373361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.374476 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.374479 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.374949 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.374950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.375024 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.375563 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:53.375567 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:53.377559 (+ 1992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:53.398390 (+ 20831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.398391 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.398391 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.398572 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.398787 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.398787 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.398788 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.398838 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.399071 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:53.399072 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:53.399115 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.399187 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.399281 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":3,"thread_start_us":57,"threads_started":1}
I20260807 20:17:53.399912 10402 heartbeater.cc:347] Connected to a master server at 127.30.35.252:33809
I20260807 20:17:53.399963 10402 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:53.400012 10402 heartbeater.cc:511] Master 127.30.35.252:33809 requested a full tablet report, sending...
I20260807 20:17:53.400285 9835 ts_manager.cc:194] Registered new tserver with Master: c33dc8adf30347d0851a35e14eab6d25 (127.30.35.194:33857)
I20260807 20:17:53.402539 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:40203
--local_ip_for_outbound_sockets=127.30.35.195
--tserver_master_addrs=127.30.35.254:34587
--webserver_port=44437
--webserver_interface=127.30.35.195
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.195.keytab
--principal=oryx/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.30.35.254:34587,127.30.35.253:45139
--tserver_master_addrs=127.30.35.254:34587,127.30.35.253:45139,127.30.35.252:33809 with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:53.486299 10421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:53.486541 10421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:53.486565 10421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:53.487748 10421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:53.487798 10421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:53.487825 10421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:17:53.489293 10421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.195.keytab
--principal=oryx/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:40203
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=44437
--tserver_master_addrs=127.30.35.254:34587,127.30.35.253:45139,127.30.35.252:33809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:53.489472 10421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:53.489637 10421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:53.494249 10448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:53.494292 10431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:53.494269 10427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:53.494562 10421 server_base.cc:1034] running on GCE node
I20260807 20:17:53.494724 10421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:53.494915 10421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:53.496063 10421 hybrid_clock.cc:648] HybridClock initialized: now 1786133873496052 us; error 26 us; skew 500 ppm
Aug 07 20:17:53 dist-test-slave-t7g5 krb5kdc[8322](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133873, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:53.498502 10421 init.cc:377] Logged in from keytab as oryx/127.30.35.195@KRBTEST.COM (short username oryx)
I20260807 20:17:53.498942 10421 webserver.cc:460] Webserver started at http://127.30.35.195:44437/ using document root <none> and password file <none>
I20260807 20:17:53.499138 10421 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:53.499195 10421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:53.500464 10421 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:53.501062 10459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:53.501221 10421 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:53.501309 10421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "8cc5e1d582b547908b99986dee2b2a94"
format_stamp: "Formatted at 2026-08-07 20:17:52 on dist-test-slave-t7g5"
server_key: "2d01f7ff141d4115ec0301b50ee4661d"
server_key_iv: "ed807b66c7ff506a395f35e3e52f5497"
server_key_version: "encryptionkey@0"
I20260807 20:17:53.501621 10421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:53.515326 10421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:53.517027 10421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:53.517160 10421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:53.517359 10421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:17:53.517640 10421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:53.517696 10421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:53.517724 10421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:53.517746 10421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:53.523372 10421 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:40203
I20260807 20:17:53.523439 10655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:40203 every 8 connection(s)
I20260807 20:17:53.523741 10421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:17:53.529280 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 10421
Aug 07 20:17:53 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133873, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.253@KRBTEST.COM
Aug 07 20:17:53 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133873, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
I20260807 20:17:53.534621 10662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.524454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:45139 (local address 127.30.35.195:43291)
0807 20:17:53.524613 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.524648 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.525191 (+ 543us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.525463 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.525468 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.525865 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:53.526067 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.526071 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.527073 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.527074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.528312 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.528314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.528724 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.528725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.528781 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.529475 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:53.529479 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:53.531226 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:53.532928 (+ 1702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.532935 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.532937 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.533222 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.533444 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.533445 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.533445 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.533572 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.533914 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:53.533921 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:53.534077 (+ 156us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.534182 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.534368 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":44,"spinlock_wait_cycles":384,"thread_start_us":86,"threads_started":1}
I20260807 20:17:53.534986 9595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.524457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:43291 (local address 127.30.35.253:45139)
0807 20:17:53.524499 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.524501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.524735 (+ 234us) server_negotiation.cc:407] Connection header received
0807 20:17:53.525358 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.525360 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.525373 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.525433 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.526161 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.526933 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.528385 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.528662 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.528712 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.531328 (+ 2616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.531329 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.531329 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.531337 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.532840 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.533304 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.533305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.533306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.533366 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.533697 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.533698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.533698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.533834 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.533890 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.534819 (+ 929us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.534899 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:17:53.535295 10661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.524454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.195:53157)
0807 20:17:53.524852 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.524861 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.525206 (+ 345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.525507 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.525508 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.525874 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:53.526067 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.526073 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.527073 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.527074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.528301 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.528304 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.529070 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.529071 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.529166 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.529630 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:53.529634 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:53.531841 (+ 2207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:53.533812 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.533813 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.533813 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.534016 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.534212 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.534213 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.534213 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.534267 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.534787 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:53.534788 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:53.534827 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.534885 (+ 58us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.535188 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"mutex_wait_us":34,"thread_start_us":85,"threads_started":1}
I20260807 20:17:53.535362 10658 heartbeater.cc:347] Connected to a master server at 127.30.35.253:45139
I20260807 20:17:53.535475 10658 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:53.535637 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.524440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:53157 (local address 127.30.35.254:34587)
0807 20:17:53.524485 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.524487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.524936 (+ 449us) server_negotiation.cc:407] Connection header received
0807 20:17:53.525422 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.525423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.525436 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.525484 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.526192 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.526943 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.528763 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.528981 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.529044 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.531955 (+ 2911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.531956 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.531956 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.531964 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.533738 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.534089 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.534090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.534090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.534150 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.534329 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.534330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.534331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.534694 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.534758 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.535484 (+ 726us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.535549 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:17:53.535660 10658 heartbeater.cc:511] Master 127.30.35.253:45139 requested a full tablet report, sending...
I20260807 20:17:53.536211 9513 ts_manager.cc:194] Registered new tserver with Master: 8cc5e1d582b547908b99986dee2b2a94 (127.30.35.195:40203)
I20260807 20:17:53.536474 10657 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34587
I20260807 20:17:53.536520 10657 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:53.536568 10657 heartbeater.cc:511] Master 127.30.35.254:34587 requested a full tablet report, sending...
Aug 07 20:17:53 dist-test-slave-t7g5 krb5kdc[8322](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133873, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.252@KRBTEST.COM
I20260807 20:17:53.536834 8417 ts_manager.cc:194] Re-registered known tserver with Master: 8cc5e1d582b547908b99986dee2b2a94 (127.30.35.195:40203)
I20260807 20:17:53.537278 8417 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:53157
I20260807 20:17:53.539994 9944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.524812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:49499 (local address 127.30.35.252:33809)
0807 20:17:53.524859 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.524861 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.524945 (+ 84us) server_negotiation.cc:407] Connection header received
0807 20:17:53.525287 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.525288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.525301 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.525355 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.527031 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.527489 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.528276 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.528528 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.528592 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.537170 (+ 8578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.537171 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.537171 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.537179 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.538782 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.539205 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.539206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.539207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.539272 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.539464 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.539465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.539465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.539581 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.539619 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.539810 (+ 191us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.539905 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 20:17:53.540208 10677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.531080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33020 (local address 127.30.35.252:33809)
0807 20:17:53.531317 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.531319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.531624 (+ 305us) server_negotiation.cc:407] Connection header received
0807 20:17:53.531647 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.531648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.531659 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.531715 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.532377 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.533060 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.534025 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.534317 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.534377 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.537292 (+ 2915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.537293 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.537293 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.537299 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.538999 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.539337 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.539337 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.539338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.539387 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.539567 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.539568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.539568 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.539666 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.539760 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.540060 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.540131 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":51,"threads_started":1}
I20260807 20:17:53.540764 10663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.524733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:33809 (local address 127.30.35.195:49499)
0807 20:17:53.524890 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.524898 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.525206 (+ 308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.525860 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.525861 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.525993 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:53.526067 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.526073 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.527571 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.527573 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.528193 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.528194 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.528601 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.528601 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.528704 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.529397 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:53.529408 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:53.537073 (+ 7665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:53.538932 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.538933 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.538934 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.539130 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.539342 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:53.539342 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:53.539342 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:53.539396 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:53.539664 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:53.539665 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:53.539705 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.540199 (+ 494us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.540662 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":104,"threads_started":1}
I20260807 20:17:53.541062 10656 heartbeater.cc:347] Connected to a master server at 127.30.35.252:33809
I20260807 20:17:53.541388 10672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.530686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54306 (local address 127.30.35.254:34587)
0807 20:17:53.530837 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.530839 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.531038 (+ 199us) server_negotiation.cc:407] Connection header received
0807 20:17:53.531134 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.531135 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.531148 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.531195 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.532000 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.532772 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.533794 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.534090 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.534126 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.537712 (+ 3586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.537714 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.537714 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.537721 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.540062 (+ 2341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.540549 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.540550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.540550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.540613 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.540823 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.540825 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.540825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.540946 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.541021 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.541219 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.541304 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":83,"threads_started":1}
I20260807 20:17:53.541105 10656 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:53.541575 10656 heartbeater.cc:511] Master 127.30.35.252:33809 requested a full tablet report, sending...
I20260807 20:17:53.541836 9835 ts_manager.cc:194] Registered new tserver with Master: 8cc5e1d582b547908b99986dee2b2a94 (127.30.35.195:40203)
I20260807 20:17:53.544358 10671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.530582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44414 (local address 127.30.35.253:45139)
0807 20:17:53.536206 (+ 5624us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.536208 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.536217 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:53.536234 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.536235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.536257 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.536360 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.537871 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.538643 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.539613 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.539906 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.540215 (+ 309us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.541403 (+ 1188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.541404 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.541404 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.541422 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.543083 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.543434 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.543435 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.543435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.543491 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.543674 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.543674 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.543675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.543783 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.544164 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.544201 (+ 37us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.544274 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4428,"thread_start_us":58,"threads_started":1}
I20260807 20:17:53.544600 10680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.541341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:33809 (local address 127.0.0.1:33032)
0807 20:17:53.542041 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.542050 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.542121 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.542316 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.542317 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.542319 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:53.542357 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.542358 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.543101 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.543102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.543799 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.543800 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.544385 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.544386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.544446 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.544450 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.544496 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.544535 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"thread_start_us":50,"threads_started":1}
I20260807 20:17:53.544853 10677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.541468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33032 (local address 127.30.35.252:33809)
0807 20:17:53.541497 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.541499 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.542097 (+ 598us) server_negotiation.cc:407] Connection header received
0807 20:17:53.542186 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.542186 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.542210 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.542260 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:53.542520 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.543028 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.543872 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.544318 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.544373 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.544447 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.544641 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.544681 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260807 20:17:53.543053 8417 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 20:17:53.545076 9857 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
W20260807 20:17:53.545179 8417 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:53.545241 9925 sys_catalog.cc:455] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e39e037a3a2f43a9baa7ced95a715067. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } } }
I20260807 20:17:53.545318 9925 sys_catalog.cc:458] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [sys.catalog]: This master's current role is: LEARNER
I20260807 20:17:53.545923 9772 sys_catalog.cc:455] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: NON_VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: true } } }
I20260807 20:17:53.546017 9772 sys_catalog.cc:458] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:53.547019 9772 raft_consensus.cc:1050] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067: attempting to promote NON_VOTER 209b89c5016e4c37ab3cb8a018ff1aa8 to VOTER
I20260807 20:17:53.547125 9772 consensus_queue.cc:237] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } }
I20260807 20:17:53.547483 9528 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 FOLLOWER]: Refusing update from remote peer e39e037a3a2f43a9baa7ced95a715067: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 20:17:53.547502 9857 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 1 LEARNER]: Refusing update from remote peer e39e037a3a2f43a9baa7ced95a715067: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260807 20:17:53.547662 10684 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [LEADER]: Connected to new peer: Peer: permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 20:17:53.547783 10685 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 20:17:53.548384 10684 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 209b89c5016e4c37ab3cb8a018ff1aa8 (127.30.35.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } } }
I20260807 20:17:53.548540 9528 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 209b89c5016e4c37ab3cb8a018ff1aa8 (127.30.35.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } } }
I20260807 20:17:53.549067 9857 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 209b89c5016e4c37ab3cb8a018ff1aa8 (127.30.35.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } } }
I20260807 20:17:53.549310 10684 sys_catalog.cc:455] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } } }
I20260807 20:17:53.549431 10684 sys_catalog.cc:458] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:53.549445 10696 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } } }
I20260807 20:17:53.549490 10684 sys_catalog.cc:455] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } } }
I20260807 20:17:53.549530 10684 sys_catalog.cc:458] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:53.549527 10696 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:17:53.549566 10684 sys_catalog.cc:455] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } } }
I20260807 20:17:53.549598 10684 sys_catalog.cc:458] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:53.550086 9925 sys_catalog.cc:455] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e39e037a3a2f43a9baa7ced95a715067" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } } }
I20260807 20:17:53.550184 9925 sys_catalog.cc:458] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:17:53.555262 10680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.551292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:40203 (local address 127.0.0.1:55200)
0807 20:17:53.551340 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.551351 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.551387 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.551812 (+ 425us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.551813 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.551815 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:53.551848 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.551849 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.553033 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.553034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.554161 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.554163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.555067 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.555068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.555118 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.555121 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.555157 (+ 36us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.555190 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":16}
I20260807 20:17:53.555186 10703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.551382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:44223 (local address 127.0.0.1:41016)
0807 20:17:53.551748 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.551758 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.551815 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.552077 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.552078 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.552080 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:53.552117 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.552119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.553071 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.553072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.554263 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.554266 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.554958 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.554959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.555018 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.555022 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.555071 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.555108 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"mutex_wait_us":3,"thread_start_us":79,"threads_started":1}
I20260807 20:17:53.555303 10700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.551466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55200 (local address 127.30.35.195:40203)
0807 20:17:53.551630 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.551634 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.551646 (+ 12us) server_negotiation.cc:407] Connection header received
0807 20:17:53.551682 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.551684 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.551700 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.551918 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:53.551968 (+ 50us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.552958 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.554238 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.554950 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.555090 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.555167 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.555193 (+ 26us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.555228 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":91,"threads_started":1}
I20260807 20:17:53.555576 10697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.551544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:33857 (local address 127.0.0.1:54564)
0807 20:17:53.552210 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.552218 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.552276 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.552447 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.552448 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.552450 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:53.552483 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.552485 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.553439 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.553440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.554387 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.554390 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.555339 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.555340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.555401 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.555405 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.555474 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.555511 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":648,"thread_start_us":74,"threads_started":1}
I20260807 20:17:53.555605 10701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.551514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41016 (local address 127.30.35.193:44223)
0807 20:17:53.551697 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.551701 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.551870 (+ 169us) server_negotiation.cc:407] Connection header received
0807 20:17:53.551921 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.551923 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.551939 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.552010 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:53.552202 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.552987 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.554323 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.554887 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.554951 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.555026 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.555246 (+ 220us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.555520 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":75,"threads_started":1}
I20260807 20:17:53.555797 10704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.551737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54564 (local address 127.30.35.194:33857)
0807 20:17:53.551915 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.551919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.552292 (+ 373us) server_negotiation.cc:407] Connection header received
0807 20:17:53.552340 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.552342 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.552359 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.552442 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:53.552544 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.553363 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.554489 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.555181 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.555239 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.555304 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.555679 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.555723 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":96,"threads_started":1}
I20260807 20:17:53.556035 10539 tablet_service.cc:1467] Processing CreateTablet for tablet 5ddd252999fe44498d8b9fad9e773d14 (DEFAULT_TABLE table=test-table [id=0689cdea5fdb40479660962ba9f33634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:53.556154 10063 tablet_service.cc:1467] Processing CreateTablet for tablet 5ddd252999fe44498d8b9fad9e773d14 (DEFAULT_TABLE table=test-table [id=0689cdea5fdb40479660962ba9f33634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:53.556341 10539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ddd252999fe44498d8b9fad9e773d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:53.556401 10063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ddd252999fe44498d8b9fad9e773d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:53.558823 10705 tablet_bootstrap.cc:492] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94: Bootstrap starting.
I20260807 20:17:53.559533 10705 tablet_bootstrap.cc:654] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:53.559501 10284 tablet_service.cc:1467] Processing CreateTablet for tablet 5ddd252999fe44498d8b9fad9e773d14 (DEFAULT_TABLE table=test-table [id=0689cdea5fdb40479660962ba9f33634]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:53.559775 10284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ddd252999fe44498d8b9fad9e773d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:53.559803 10705 log.cc:824] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:53.560103 10711 tablet_bootstrap.cc:492] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5: Bootstrap starting.
I20260807 20:17:53.560462 10705 tablet_bootstrap.cc:492] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94: No bootstrap required, opened a new log
I20260807 20:17:53.560515 10705 ts_tablet_manager.cc:1397] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:53.562368 10713 tablet_bootstrap.cc:492] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25: Bootstrap starting.
I20260807 20:17:53.562525 10711 tablet_bootstrap.cc:654] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:53.562561 10705 raft_consensus.cc:348] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:53.562723 10705 raft_consensus.cc:374] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:53.562764 10705 raft_consensus.cc:729] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cc5e1d582b547908b99986dee2b2a94, State: Initialized, Role: FOLLOWER
I20260807 20:17:53.562871 10711 log.cc:824] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:53.562878 10705 consensus_queue.cc:260] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:53.563005 10713 tablet_bootstrap.cc:654] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:53.563136 10705 ts_tablet_manager.cc:1428] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:17:53.563306 10713 log.cc:824] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:53.563462 10657 heartbeater.cc:503] Master 127.30.35.254:34587 was elected leader, sending a full tablet report...
I20260807 20:17:53.564010 10711 tablet_bootstrap.cc:492] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5: No bootstrap required, opened a new log
I20260807 20:17:53.564010 10713 tablet_bootstrap.cc:492] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25: No bootstrap required, opened a new log
I20260807 20:17:53.564069 10713 ts_tablet_manager.cc:1397] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:53.564069 10711 ts_tablet_manager.cc:1397] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260807 20:17:53.565979 10711 raft_consensus.cc:348] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:53.566147 10711 raft_consensus.cc:374] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:53.566192 10711 raft_consensus.cc:729] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3133b441314a4fbd91f4a74723f58cd5, State: Initialized, Role: FOLLOWER
I20260807 20:17:53.566315 10711 consensus_queue.cc:260] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:53.566560 10711 ts_tablet_manager.cc:1428] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260807 20:17:53.566584 10175 heartbeater.cc:503] Master 127.30.35.254:34587 was elected leader, sending a full tablet report...
I20260807 20:17:53.566555 10713 raft_consensus.cc:348] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:53.566690 10713 raft_consensus.cc:374] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:53.566725 10713 raft_consensus.cc:729] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c33dc8adf30347d0851a35e14eab6d25, State: Initialized, Role: FOLLOWER
I20260807 20:17:53.566836 10713 consensus_queue.cc:260] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:53.567066 10713 ts_tablet_manager.cc:1428] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:17:53.567206 10405 heartbeater.cc:503] Master 127.30.35.254:34587 was elected leader, sending a full tablet report...
W20260807 20:17:53.620690 10407 tablet.cc:2369] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:17:53.730252 10179 tablet.cc:2369] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:17:53.761466 10714 raft_consensus.cc:482] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:53.761627 10714 raft_consensus.cc:504] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:53.762064 10714 leader_election.cc:288] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3133b441314a4fbd91f4a74723f58cd5 (127.30.35.193:44223), c33dc8adf30347d0851a35e14eab6d25 (127.30.35.194:33857)
I20260807 20:17:53.764966 10704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.762422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:54695 (local address 127.30.35.194:33857)
0807 20:17:53.762487 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.762489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.762497 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:53.762521 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.762522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.762529 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.762572 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:53.762705 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.763177 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.764214 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.764630 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.764691 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.764699 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.764827 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.764863 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 20:17:53.764976 10661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.762361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:33857 (local address 127.30.35.195:54695)
0807 20:17:53.762417 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.762425 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.762454 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.762584 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.762585 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.762587 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:53.762650 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.762652 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.763246 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.763247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.764138 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.764141 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.764699 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.764700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.764769 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.764772 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.764816 (+ 44us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.764856 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":41}
I20260807 20:17:53.764990 10701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.762313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:44565 (local address 127.30.35.193:44223)
0807 20:17:53.762383 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.762385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.762396 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:17:53.762430 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.762431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.762443 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.762530 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:53.762696 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.763188 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.764266 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.764617 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.764688 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.764698 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.764866 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.764900 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 20:17:53.764988 10663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.762237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:44223 (local address 127.30.35.195:44565)
0807 20:17:53.762286 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:53.762298 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:53.762347 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:53.762540 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:53.762542 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:53.762544 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:53.762623 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.762625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.763279 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.763280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.764182 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:53.764186 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.764692 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.764693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:53.764792 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.764796 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:53.764842 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 20:17:53.764885 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":20}
I20260807 20:17:53.765343 10097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ddd252999fe44498d8b9fad9e773d14" candidate_uuid: "8cc5e1d582b547908b99986dee2b2a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3133b441314a4fbd91f4a74723f58cd5" is_pre_election: true
I20260807 20:17:53.765349 10317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ddd252999fe44498d8b9fad9e773d14" candidate_uuid: "8cc5e1d582b547908b99986dee2b2a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c33dc8adf30347d0851a35e14eab6d25" is_pre_election: true
I20260807 20:17:53.765506 10097 raft_consensus.cc:2454] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cc5e1d582b547908b99986dee2b2a94 in term 0.
I20260807 20:17:53.765504 10317 raft_consensus.cc:2454] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cc5e1d582b547908b99986dee2b2a94 in term 0.
I20260807 20:17:53.765775 10461 leader_election.cc:302] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3133b441314a4fbd91f4a74723f58cd5, 8cc5e1d582b547908b99986dee2b2a94; no voters:
I20260807 20:17:53.765920 10714 raft_consensus.cc:2781] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:53.765986 10714 raft_consensus.cc:482] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:53.766023 10714 raft_consensus.cc:3037] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:53.766778 10714 raft_consensus.cc:504] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:53.766894 10714 leader_election.cc:288] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [CANDIDATE]: Term 1 election: Requested vote from peers 3133b441314a4fbd91f4a74723f58cd5 (127.30.35.193:44223), c33dc8adf30347d0851a35e14eab6d25 (127.30.35.194:33857)
I20260807 20:17:53.767063 10097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ddd252999fe44498d8b9fad9e773d14" candidate_uuid: "8cc5e1d582b547908b99986dee2b2a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3133b441314a4fbd91f4a74723f58cd5"
I20260807 20:17:53.767135 10317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ddd252999fe44498d8b9fad9e773d14" candidate_uuid: "8cc5e1d582b547908b99986dee2b2a94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c33dc8adf30347d0851a35e14eab6d25"
I20260807 20:17:53.767150 10097 raft_consensus.cc:3037] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:53.767207 10317 raft_consensus.cc:3037] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:53.767982 10097 raft_consensus.cc:2454] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cc5e1d582b547908b99986dee2b2a94 in term 1.
I20260807 20:17:53.767982 10317 raft_consensus.cc:2454] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cc5e1d582b547908b99986dee2b2a94 in term 1.
I20260807 20:17:53.768157 10461 leader_election.cc:302] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3133b441314a4fbd91f4a74723f58cd5, 8cc5e1d582b547908b99986dee2b2a94; no voters:
I20260807 20:17:53.768275 10714 raft_consensus.cc:2781] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:53.768437 10714 raft_consensus.cc:686] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [term 1 LEADER]: Becoming Leader. State: Replica: 8cc5e1d582b547908b99986dee2b2a94, State: Running, Role: LEADER
I20260807 20:17:53.768524 10714 consensus_queue.cc:237] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:53.769373 8416 catalog_manager.cc:5495] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cc5e1d582b547908b99986dee2b2a94 (127.30.35.195). New cstate: current_term: 1 leader_uuid: "8cc5e1d582b547908b99986dee2b2a94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } health_report { overall_health: UNKNOWN } } }
W20260807 20:17:53.774423 10660 tablet.cc:2369] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:17:53.781769 10700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.779424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52996 (local address 127.30.35.195:40203)
0807 20:17:53.779461 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.779463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.779487 (+ 24us) server_negotiation.cc:407] Connection header received
0807 20:17:53.779565 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.779566 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.779581 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.779630 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:53.779789 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.780348 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.781118 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.781316 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.781373 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.781490 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:53.781585 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:53.781642 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.781681 (+ 39us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.781702 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 20:17:53.783397 10317 raft_consensus.cc:1261] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25 [term 1 FOLLOWER]: Refusing update from remote peer 8cc5e1d582b547908b99986dee2b2a94: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:53.783437 10097 raft_consensus.cc:1261] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5 [term 1 FOLLOWER]: Refusing update from remote peer 8cc5e1d582b547908b99986dee2b2a94: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:53.783720 10714 consensus_queue.cc:1035] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:53.783864 10721 consensus_queue.cc:1035] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:53.786052 10728 mvcc.cc:205] Tried to move back new op lower bound from 7316004347014500352 to 7316004346956509184. Current Snapshot: MvccSnapshot[applied={T|T < 7316004347014500352}]
I20260807 20:17:53.787938 10730 mvcc.cc:205] Tried to move back new op lower bound from 7316004347014500352 to 7316004346956509184. Current Snapshot: MvccSnapshot[applied={T|T < 7316004347014500352 or (T in {7316004347014500352})}]
I20260807 20:17:53.788570 8416 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:53.788662 8416 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:53.789057 10729 mvcc.cc:205] Tried to move back new op lower bound from 7316004347014500352 to 7316004346956509184. Current Snapshot: MvccSnapshot[applied={T|T < 7316004347014500352 or (T in {7316004347014500352})}]
I20260807 20:17:53.790091 8416 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e39e037a3a2f43a9baa7ced95a715067: Sending DeleteTablet for 3 replicas of tablet 5ddd252999fe44498d8b9fad9e773d14
I20260807 20:17:53.790387 10539 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ddd252999fe44498d8b9fad9e773d14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:53 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:55200
I20260807 20:17:53.790431 10063 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ddd252999fe44498d8b9fad9e773d14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:53 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:41016
I20260807 20:17:53.790915 10284 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ddd252999fe44498d8b9fad9e773d14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:53 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:54564
I20260807 20:17:53.791138 10741 tablet_replica.cc:330] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25: stopping tablet replica
I20260807 20:17:53.791237 10741 raft_consensus.cc:2229] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:53.791342 10738 tablet_replica.cc:330] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5: stopping tablet replica
I20260807 20:17:53.791357 10741 raft_consensus.cc:2258] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:53.791424 10738 raft_consensus.cc:2229] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:53.791507 10738 raft_consensus.cc:2258] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:53.791783 10739 tablet_replica.cc:330] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94: stopping tablet replica
I20260807 20:17:53.791780 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 8351
I20260807 20:17:53.791878 10739 raft_consensus.cc:2229] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:17:53.791916 10738 ts_tablet_manager.cc:1905] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:53.791965 10739 raft_consensus.cc:2258] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:53.794289 10738 ts_tablet_manager.cc:1918] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:53.794364 10738 log.cc:1196] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-0/wal/wals/5ddd252999fe44498d8b9fad9e773d14
I20260807 20:17:53.794618 10738 ts_tablet_manager.cc:1939] T 5ddd252999fe44498d8b9fad9e773d14 P 3133b441314a4fbd91f4a74723f58cd5: Deleting consensus metadata
I20260807 20:17:53.795037 10739 ts_tablet_manager.cc:1905] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:53.796638 10739 ts_tablet_manager.cc:1918] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:53.796715 10739 log.cc:1196] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/5ddd252999fe44498d8b9fad9e773d14
I20260807 20:17:53.796991 10739 ts_tablet_manager.cc:1939] T 5ddd252999fe44498d8b9fad9e773d14 P 8cc5e1d582b547908b99986dee2b2a94: Deleting consensus metadata
I20260807 20:17:53.802052 10741 ts_tablet_manager.cc:1905] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:53.803666 10741 ts_tablet_manager.cc:1918] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:53.803747 10741 log.cc:1196] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/5ddd252999fe44498d8b9fad9e773d14
I20260807 20:17:53.804003 10741 ts_tablet_manager.cc:1939] T 5ddd252999fe44498d8b9fad9e773d14 P c33dc8adf30347d0851a35e14eab6d25: Deleting consensus metadata
W20260807 20:17:53.805042 10213 connection.cc:535] server connection from 127.0.0.1:54564 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 20:17:53.805073 9980 connection.cc:535] server connection from 127.0.0.1:41016 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260807 20:17:53.805192 10466 connection.cc:535] server connection from 127.0.0.1:55200 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 20:17:53.813153 10677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.807058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34622 (local address 127.30.35.252:33809)
0807 20:17:53.807095 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.807096 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.807106 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:17:53.807221 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.807222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.807233 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.807280 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.807802 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.808291 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.808949 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.809153 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.809208 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.810539 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.810540 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.810541 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.810547 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.812017 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.812395 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.812396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.812396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.812461 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.812645 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.812646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.812647 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.812787 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.812891 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.812986 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.813063 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:17:53.814260 10671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:53.806905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42292 (local address 127.30.35.253:45139)
0807 20:17:53.806948 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:53.806950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:53.807074 (+ 124us) server_negotiation.cc:407] Connection header received
0807 20:17:53.807180 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:53.807181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:53.807198 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:53.807254 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:53.807961 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.808736 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.809774 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:53.810080 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:53.810160 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:53.811419 (+ 1259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:53.811420 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:53.811421 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:53.811428 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:53.812966 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.813437 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.813438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.813438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.813527 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:53.813840 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:53.813841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:53.813841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:53.813953 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:53.814027 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:53.814138 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 20:17:53.814202 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:17:54.788197 10757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:54.787897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.193:55779)
0807 20:17:54.788043 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:54.788136 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":65,"threads_started":1}
W20260807 20:17:54.788477 10175 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:34587 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
I20260807 20:17:54.788766 10762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:54.788536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.195:57009)
0807 20:17:54.788637 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:54.788713 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84,"thread_start_us":58,"threads_started":1}
W20260807 20:17:54.788944 10657 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:34587 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
I20260807 20:17:54.791266 10764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:54.791090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.194:42941)
0807 20:17:54.791179 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:54.791229 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76,"thread_start_us":44,"threads_started":1}
W20260807 20:17:54.791453 10405 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:34587 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
I20260807 20:17:55.290624 10765 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e39e037a3a2f43a9baa7ced95a715067)
I20260807 20:17:55.290794 10765 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } }
I20260807 20:17:55.291090 10765 leader_election.cc:288] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e39e037a3a2f43a9baa7ced95a715067 (127.30.35.254:34587), 209b89c5016e4c37ab3cb8a018ff1aa8 (127.30.35.252:33809)
I20260807 20:17:55.291221 10771 raft_consensus.cc:482] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e39e037a3a2f43a9baa7ced95a715067)
I20260807 20:17:55.291340 10771 raft_consensus.cc:504] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } }
I20260807 20:17:55.291594 10775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.291218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.0.0.1:43268)
0807 20:17:55.291483 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.291547 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":47,"threads_started":1}
W20260807 20:17:55.291885 9490 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
I20260807 20:17:55.291980 10776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.291665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.0.0.1:43280)
0807 20:17:55.291884 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.291945 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":44,"threads_started":1}
W20260807 20:17:55.292213 9815 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
I20260807 20:17:55.292375 10775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.292291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.0.0.1:43284)
0807 20:17:55.292326 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.292349 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260807 20:17:55.292403 10771 leader_election.cc:288] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e39e037a3a2f43a9baa7ced95a715067 (127.30.35.254:34587), 5550be937dfa46f6a4689be4050430c6 (127.30.35.253:45139)
W20260807 20:17:55.292465 9490 leader_election.cc:334] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e39e037a3a2f43a9baa7ced95a715067 (127.30.35.254:34587): Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
I20260807 20:17:55.292706 10782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.292600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.0.0.1:43286)
0807 20:17:55.292645 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.292677 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 20:17:55.292773 9815 leader_election.cc:334] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e39e037a3a2f43a9baa7ced95a715067 (127.30.35.254:34587): Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
I20260807 20:17:55.294678 10781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.291730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34626 (local address 127.30.35.252:33809)
0807 20:17:55.291833 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:55.291835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:55.291842 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:17:55.291865 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:55.291866 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:55.291878 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:55.292250 (+ 372us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:55.292347 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.293096 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.294040 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.294404 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.294463 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.294474 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:55.294582 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 20:17:55.294621 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":43,"threads_started":1}
I20260807 20:17:55.294678 10773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.291364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:33809 (local address 127.0.0.1:34626)
0807 20:17:55.291555 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.291570 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:55.291728 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:55.292026 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:55.292027 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:55.292029 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:55.292092 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:55.292095 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.293176 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.293176 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:55.293967 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:55.293969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.294472 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.294473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:55.294525 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.294529 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:55.294572 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 20:17:55.294613 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":68,"threads_started":1}
I20260807 20:17:55.294773 10785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.292052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42294 (local address 127.30.35.253:45139)
0807 20:17:55.292272 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:55.292274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:55.292280 (+ 6us) server_negotiation.cc:407] Connection header received
0807 20:17:55.292306 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:55.292307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:55.292316 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:55.292448 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:55.292650 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.293187 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.294109 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.294477 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.294535 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.294545 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:55.294668 (+ 123us) server_negotiation.cc:299] Negotiation successful
0807 20:17:55.294705 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":83,"threads_started":1}
I20260807 20:17:55.294925 10776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.291924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:45139 (local address 127.0.0.1:42294)
0807 20:17:55.292042 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.292051 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:55.292097 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:55.292409 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:55.292410 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:55.292412 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:55.292567 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:55.292570 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.293263 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.293264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:55.294035 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:55.294038 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.294544 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.294545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:55.294609 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.294614 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:17:55.294659 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:17:55.294698 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":91,"thread_start_us":51,"threads_started":1}
I20260807 20:17:55.294939 9857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5550be937dfa46f6a4689be4050430c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" is_pre_election: true
I20260807 20:17:55.295042 9857 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5550be937dfa46f6a4689be4050430c6 in term 1.
I20260807 20:17:55.295184 9490 leader_election.cc:302] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 209b89c5016e4c37ab3cb8a018ff1aa8, 5550be937dfa46f6a4689be4050430c6; no voters: e39e037a3a2f43a9baa7ced95a715067
I20260807 20:17:55.295193 9528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5550be937dfa46f6a4689be4050430c6" is_pre_election: true
I20260807 20:17:55.295312 10765 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 20:17:55.295370 10765 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e39e037a3a2f43a9baa7ced95a715067)
I20260807 20:17:55.295397 10765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 1 FOLLOWER]: Advancing to term 2
I20260807 20:17:55.296087 10765 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } }
I20260807 20:17:55.296205 9528 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 209b89c5016e4c37ab3cb8a018ff1aa8 in current term 2: Already voted for candidate 5550be937dfa46f6a4689be4050430c6 in this term.
I20260807 20:17:55.296206 10765 leader_election.cc:288] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [CANDIDATE]: Term 2 election: Requested vote from peers e39e037a3a2f43a9baa7ced95a715067 (127.30.35.254:34587), 209b89c5016e4c37ab3cb8a018ff1aa8 (127.30.35.252:33809)
I20260807 20:17:55.296396 10773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.296285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.0.0.1:43290)
0807 20:17:55.296351 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.296374 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 20:17:55.296415 9857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5550be937dfa46f6a4689be4050430c6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8"
I20260807 20:17:55.296489 9857 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 1 FOLLOWER]: Advancing to term 2
I20260807 20:17:55.296607 9809 leader_election.cc:302] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 209b89c5016e4c37ab3cb8a018ff1aa8; no voters: 5550be937dfa46f6a4689be4050430c6, e39e037a3a2f43a9baa7ced95a715067
I20260807 20:17:55.296792 10773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.296647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.0.0.1:43306)
0807 20:17:55.296739 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.296769 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260807 20:17:55.296849 9490 leader_election.cc:334] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e39e037a3a2f43a9baa7ced95a715067 (127.30.35.254:34587): Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
I20260807 20:17:55.297192 9857 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5550be937dfa46f6a4689be4050430c6 in term 2.
I20260807 20:17:55.297266 10771 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 20:17:55.297437 9490 leader_election.cc:302] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 209b89c5016e4c37ab3cb8a018ff1aa8, 5550be937dfa46f6a4689be4050430c6; no voters: e39e037a3a2f43a9baa7ced95a715067
I20260807 20:17:55.297542 10765 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 20:17:55.297703 10765 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [term 2 LEADER]: Becoming Leader. State: Replica: 5550be937dfa46f6a4689be4050430c6, State: Running, Role: LEADER
I20260807 20:17:55.297775 10765 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } }
I20260807 20:17:55.298074 10788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5550be937dfa46f6a4689be4050430c6. Latest consensus state: current_term: 2 leader_uuid: "5550be937dfa46f6a4689be4050430c6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } } }
I20260807 20:17:55.298166 10788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:55.298336 10792 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:55.298828 10792 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:55.298897 10792 catalog_manager.cc:1259] Loaded cluster ID: 49e61e9f17cd4f238964dafa3b62a1f1
I20260807 20:17:55.298918 10792 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:17:55.299023 10792 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:55.299072 10792 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: Loaded TSK: 0
I20260807 20:17:55.299162 10792 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:17:55.350749 9512 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:17:55.352344 9512 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:55.353291 10773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.353194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.0.0.1:43320)
0807 20:17:55.353232 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.353265 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260807 20:17:55.353399 9857 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [term 2 FOLLOWER]: Refusing update from remote peer 5550be937dfa46f6a4689be4050430c6: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260807 20:17:55.353632 10773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.353540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.0.0.1:43328)
0807 20:17:55.353583 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.353611 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260807 20:17:55.353679 10765 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260807 20:17:55.353825 9490 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 -> Peer e39e037a3a2f43a9baa7ced95a715067 (127.30.35.254:34587): Couldn't send request to peer e39e037a3a2f43a9baa7ced95a715067. Status: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 20:17:55.354344 10771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5550be937dfa46f6a4689be4050430c6. Latest consensus state: current_term: 2 leader_uuid: "5550be937dfa46f6a4689be4050430c6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } } }
I20260807 20:17:55.354437 10771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:17:55.354910 10765 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "5550be937dfa46f6a4689be4050430c6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } } }
I20260807 20:17:55.355000 10765 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:55.355072 10771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "5550be937dfa46f6a4689be4050430c6" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "e39e037a3a2f43a9baa7ced95a715067" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34587 } } peers { permanent_uuid: "5550be937dfa46f6a4689be4050430c6" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 45139 } attrs { promote: false } } peers { permanent_uuid: "209b89c5016e4c37ab3cb8a018ff1aa8" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 33809 } attrs { promote: false } } }
I20260807 20:17:55.355151 10771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 209b89c5016e4c37ab3cb8a018ff1aa8 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:17:55.355227 10802 mvcc.cc:205] Tried to move back new op lower bound from 7316004353445351424 to 7316004353220124672. Current Snapshot: MvccSnapshot[applied={T|T < 7316004353445351424 or (T in {7316004353445351424})}]
I20260807 20:17:55.359748 10809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.356677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:44223 (local address 127.0.0.1:55564)
0807 20:17:55.356857 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.356865 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:55.356902 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:55.357248 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:55.357249 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:55.357251 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:55.357288 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:55.357289 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.358101 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.358102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:55.358823 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:55.358825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.359527 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.359528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:55.359588 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.359593 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:17:55.359643 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 20:17:55.359683 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159}
I20260807 20:17:55.359885 10773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.356597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:40203 (local address 127.0.0.1:53012)
0807 20:17:55.356640 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.356651 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:55.356692 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:55.356918 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:55.356919 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:55.356921 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:55.356972 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:55.356974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.357907 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.357908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:55.358975 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:55.358977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.359693 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.359694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:55.359755 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.359761 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 20:17:55.359788 (+ 27us) client_negotiation.cc:240] Negotiation successful
0807 20:17:55.359826 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260807 20:17:55.359776 10811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.356988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55564 (local address 127.30.35.193:44223)
0807 20:17:55.357111 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:55.357113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:55.357121 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:55.357144 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:55.357144 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:55.357156 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:55.357240 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:55.357339 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.358037 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.358901 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.359429 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.359524 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.359537 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:55.359656 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 20:17:55.359695 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":53,"threads_started":1}
I20260807 20:17:55.360138 10807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.356670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53012 (local address 127.30.35.195:40203)
0807 20:17:55.356782 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:55.356784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:55.356791 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:17:55.356816 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:55.356817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:55.356828 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:55.357025 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:55.357060 (+ 35us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.357826 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.359062 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.359609 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.359993 (+ 384us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.360009 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:55.360028 (+ 19us) server_negotiation.cc:299] Negotiation successful
0807 20:17:55.360070 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":61,"threads_started":1}
I20260807 20:17:55.360335 10539 tablet_service.cc:1467] Processing CreateTablet for tablet 78324125f25849209703d17938a708ab (DEFAULT_TABLE table=test-table [id=10ddde5eb48f487ebdcd7ca5f7a1019e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:55.360404 10775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.356746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:33857 (local address 127.0.0.1:50978)
0807 20:17:55.356852 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.356861 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:55.356907 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:55.357200 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:55.357201 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:55.357204 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:55.357285 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:55.357287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.358515 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.358516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:55.359512 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:55.359514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.360190 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.360191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:55.360263 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.360265 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 20:17:55.360309 (+ 44us) client_negotiation.cc:240] Negotiation successful
0807 20:17:55.360344 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":18,"thread_start_us":73,"threads_started":1}
I20260807 20:17:55.360482 10539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78324125f25849209703d17938a708ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:55.360621 10063 tablet_service.cc:1467] Processing CreateTablet for tablet 78324125f25849209703d17938a708ab (DEFAULT_TABLE table=test-table [id=10ddde5eb48f487ebdcd7ca5f7a1019e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:55.360642 10810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.356810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50978 (local address 127.30.35.194:33857)
0807 20:17:55.357092 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:55.357094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:55.357100 (+ 6us) server_negotiation.cc:407] Connection header received
0807 20:17:55.357120 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:55.357120 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:55.357128 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:55.357180 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:55.357712 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.358412 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.359610 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.360126 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.360183 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.360194 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:55.360534 (+ 340us) server_negotiation.cc:299] Negotiation successful
0807 20:17:55.360577 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":50,"threads_started":1}
I20260807 20:17:55.360751 10063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78324125f25849209703d17938a708ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:55.360821 10284 tablet_service.cc:1467] Processing CreateTablet for tablet 78324125f25849209703d17938a708ab (DEFAULT_TABLE table=test-table [id=10ddde5eb48f487ebdcd7ca5f7a1019e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:55.360930 10284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78324125f25849209703d17938a708ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:55.361883 10812 tablet_bootstrap.cc:492] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94: Bootstrap starting.
I20260807 20:17:55.361967 10813 tablet_bootstrap.cc:492] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5: Bootstrap starting.
I20260807 20:17:55.362285 10813 tablet_bootstrap.cc:654] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:55.362368 10822 tablet_bootstrap.cc:492] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25: Bootstrap starting.
I20260807 20:17:55.362393 10812 tablet_bootstrap.cc:654] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:55.362730 10822 tablet_bootstrap.cc:654] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:55.363021 10812 tablet_bootstrap.cc:492] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94: No bootstrap required, opened a new log
I20260807 20:17:55.363114 10812 ts_tablet_manager.cc:1397] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:55.363150 10813 tablet_bootstrap.cc:492] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5: No bootstrap required, opened a new log
I20260807 20:17:55.363193 10813 ts_tablet_manager.cc:1397] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:55.363356 10812 raft_consensus.cc:348] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:55.363406 10822 tablet_bootstrap.cc:492] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25: No bootstrap required, opened a new log
I20260807 20:17:55.363359 10813 raft_consensus.cc:348] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:55.363437 10812 raft_consensus.cc:374] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:55.363449 10822 ts_tablet_manager.cc:1397] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:55.363459 10812 raft_consensus.cc:729] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cc5e1d582b547908b99986dee2b2a94, State: Initialized, Role: FOLLOWER
I20260807 20:17:55.363457 10813 raft_consensus.cc:374] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:55.363515 10813 raft_consensus.cc:729] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3133b441314a4fbd91f4a74723f58cd5, State: Initialized, Role: FOLLOWER
I20260807 20:17:55.363519 10812 consensus_queue.cc:260] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:55.363567 10813 consensus_queue.cc:260] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:55.363560 10822 raft_consensus.cc:348] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:55.363619 10822 raft_consensus.cc:374] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:55.363638 10822 raft_consensus.cc:729] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c33dc8adf30347d0851a35e14eab6d25, State: Initialized, Role: FOLLOWER
I20260807 20:17:55.363651 10812 ts_tablet_manager.cc:1428] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:55.363694 10813 ts_tablet_manager.cc:1428] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:55.363696 10822 consensus_queue.cc:260] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:55.364195 10822 ts_tablet_manager.cc:1428] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:55.364751 10838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.364544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.194:45269)
0807 20:17:55.364686 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.364722 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":79,"threads_started":1}
I20260807 20:17:55.364851 10830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.363957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.193:40947)
0807 20:17:55.364781 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.364819 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":799,"thread_start_us":60,"threads_started":1}
I20260807 20:17:55.365237 10406 heartbeater.cc:503] Master 127.30.35.253:45139 was elected leader, sending a full tablet report...
I20260807 20:17:55.365079 10829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.363922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.195:44087)
0807 20:17:55.365012 (+ 1090us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.365047 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1069,"thread_start_us":74,"threads_started":1}
I20260807 20:17:55.365352 10838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.365143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.194:47197)
0807 20:17:55.365251 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.365277 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":72,"threads_started":1}
I20260807 20:17:55.739677 10831 raft_consensus.cc:482] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:55.739807 10831 raft_consensus.cc:504] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:55.740159 10831 leader_election.cc:288] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cc5e1d582b547908b99986dee2b2a94 (127.30.35.195:40203), 3133b441314a4fbd91f4a74723f58cd5 (127.30.35.193:44223)
I20260807 20:17:55.743834 10811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.740609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:55059 (local address 127.30.35.193:44223)
0807 20:17:55.740654 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:55.740656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:55.740664 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:55.740689 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:55.740690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:55.740697 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:55.740740 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:55.740867 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.741556 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.742954 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.743493 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.743569 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.743580 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:55.743722 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 20:17:55.743758 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 20:17:55.743834 10807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.740399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:46811 (local address 127.30.35.195:40203)
0807 20:17:55.740454 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:55.740456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:55.740469 (+ 13us) server_negotiation.cc:407] Connection header received
0807 20:17:55.740550 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:55.740552 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:55.740563 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:55.740616 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:55.740768 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.741528 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.742955 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.743511 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.743575 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.743583 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:55.743723 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 20:17:55.743757 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 20:17:55.743871 10839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.740442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:44223 (local address 127.30.35.194:55059)
0807 20:17:55.740511 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.740523 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:55.740592 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:55.740769 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:55.740770 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:55.740772 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:55.740803 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:55.740804 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.741622 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.741622 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:55.742864 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:55.742867 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.743575 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.743577 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:55.743649 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.743653 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:55.743707 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 20:17:55.743779 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":46}
I20260807 20:17:55.743871 10838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.740320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:40203 (local address 127.30.35.194:46811)
0807 20:17:55.740409 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.740421 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:55.740480 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:55.740631 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:55.740632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:55.740634 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:55.740698 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:55.740699 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.741600 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.741601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:55.742864 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:55.742867 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.743577 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.743578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:55.743649 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.743653 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:55.743707 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 20:17:55.743780 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63,"mutex_wait_us":28}
I20260807 20:17:55.744194 10097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78324125f25849209703d17938a708ab" candidate_uuid: "c33dc8adf30347d0851a35e14eab6d25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3133b441314a4fbd91f4a74723f58cd5" is_pre_election: true
I20260807 20:17:55.744180 10573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78324125f25849209703d17938a708ab" candidate_uuid: "c33dc8adf30347d0851a35e14eab6d25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cc5e1d582b547908b99986dee2b2a94" is_pre_election: true
I20260807 20:17:55.744288 10097 raft_consensus.cc:2454] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c33dc8adf30347d0851a35e14eab6d25 in term 0.
I20260807 20:17:55.744307 10573 raft_consensus.cc:2454] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c33dc8adf30347d0851a35e14eab6d25 in term 0.
I20260807 20:17:55.744493 10209 leader_election.cc:302] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cc5e1d582b547908b99986dee2b2a94, c33dc8adf30347d0851a35e14eab6d25; no voters:
I20260807 20:17:55.744630 10831 raft_consensus.cc:2781] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:55.744671 10831 raft_consensus.cc:482] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:55.744696 10831 raft_consensus.cc:3037] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:55.745368 10831 raft_consensus.cc:504] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:55.745482 10831 leader_election.cc:288] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [CANDIDATE]: Term 1 election: Requested vote from peers 8cc5e1d582b547908b99986dee2b2a94 (127.30.35.195:40203), 3133b441314a4fbd91f4a74723f58cd5 (127.30.35.193:44223)
I20260807 20:17:55.745676 10573 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78324125f25849209703d17938a708ab" candidate_uuid: "c33dc8adf30347d0851a35e14eab6d25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cc5e1d582b547908b99986dee2b2a94"
I20260807 20:17:55.745750 10573 raft_consensus.cc:3037] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:55.745718 10097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78324125f25849209703d17938a708ab" candidate_uuid: "c33dc8adf30347d0851a35e14eab6d25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3133b441314a4fbd91f4a74723f58cd5"
I20260807 20:17:55.745808 10097 raft_consensus.cc:3037] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:55.746389 10573 raft_consensus.cc:2454] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c33dc8adf30347d0851a35e14eab6d25 in term 1.
I20260807 20:17:55.746462 10097 raft_consensus.cc:2454] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c33dc8adf30347d0851a35e14eab6d25 in term 1.
I20260807 20:17:55.746572 10209 leader_election.cc:302] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cc5e1d582b547908b99986dee2b2a94, c33dc8adf30347d0851a35e14eab6d25; no voters:
I20260807 20:17:55.746675 10831 raft_consensus.cc:2781] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:55.746862 10831 raft_consensus.cc:686] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [term 1 LEADER]: Becoming Leader. State: Replica: c33dc8adf30347d0851a35e14eab6d25, State: Running, Role: LEADER
I20260807 20:17:55.746935 10831 consensus_queue.cc:237] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } }
I20260807 20:17:55.747196 10838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.747086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.194:35031)
0807 20:17:55.747136 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.747166 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 20:17:55.747784 9513 catalog_manager.cc:5495] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 reported cstate change: term changed from 0 to 1, leader changed from <none> to c33dc8adf30347d0851a35e14eab6d25 (127.30.35.194). New cstate: current_term: 1 leader_uuid: "c33dc8adf30347d0851a35e14eab6d25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c33dc8adf30347d0851a35e14eab6d25" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33857 } health_report { overall_health: HEALTHY } } }
I20260807 20:17:55.798975 10810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.796832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50984 (local address 127.30.35.194:33857)
0807 20:17:55.796883 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:55.796885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:55.796894 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:55.796956 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:55.796957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:55.796975 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:55.797033 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:55.797131 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.797609 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.798344 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:55.798534 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:55.798581 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:55.798698 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:55.798801 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:55.798848 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:55.798875 (+ 27us) server_negotiation.cc:299] Negotiation successful
0807 20:17:55.798891 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 20:17:55.800061 10097 raft_consensus.cc:1261] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5 [term 1 FOLLOWER]: Refusing update from remote peer c33dc8adf30347d0851a35e14eab6d25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:55.800339 10573 raft_consensus.cc:1261] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94 [term 1 FOLLOWER]: Refusing update from remote peer c33dc8adf30347d0851a35e14eab6d25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:55.800340 10831 consensus_queue.cc:1035] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3133b441314a4fbd91f4a74723f58cd5" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:55.800628 10831 consensus_queue.cc:1035] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cc5e1d582b547908b99986dee2b2a94" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:55.800861 10177 heartbeater.cc:503] Master 127.30.35.253:45139 was elected leader, sending a full tablet report...
I20260807 20:17:55.801062 10830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.800945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.193:44553)
0807 20:17:55.800987 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.801031 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260807 20:17:55.801862 10658 heartbeater.cc:503] Master 127.30.35.253:45139 was elected leader, sending a full tablet report...
I20260807 20:17:55.802042 10838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.801955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.194:43427)
0807 20:17:55.801985 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.802013 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260807 20:17:55.802385 10829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.802007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.195:50397)
0807 20:17:55.802308 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.802352 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280}
I20260807 20:17:55.803949 10830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.803770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.193:36915)
0807 20:17:55.803892 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.803920 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260807 20:17:55.804004 9513 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:55.804085 9513 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42292:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:55.805576 10829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.805486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.195:54875)
0807 20:17:55.805523 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.805549 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260807 20:17:55.805754 10838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.805034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34587 (local address 127.30.35.194:42019)
0807 20:17:55.805702 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.805729 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:34587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":655}
I20260807 20:17:55.805925 9513 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5550be937dfa46f6a4689be4050430c6: Sending DeleteTablet for 3 replicas of tablet 78324125f25849209703d17938a708ab
I20260807 20:17:55.806192 10284 tablet_service.cc:1514] Processing DeleteTablet for tablet 78324125f25849209703d17938a708ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:55 UTC) from {username='oryx', principal='oryx/127.30.35.253@KRBTEST.COM'} at 127.0.0.1:50978
I20260807 20:17:55.806344 10282 tablet_service.cc:1514] Processing DeleteTablet for tablet 78324125f25849209703d17938a708ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:55 UTC) from {username='oryx', principal='oryx/127.30.35.253@KRBTEST.COM'} at 127.0.0.1:50978
I20260807 20:17:55.806403 10858 tablet_replica.cc:330] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25: stopping tablet replica
I20260807 20:17:55.806442 10539 tablet_service.cc:1514] Processing DeleteTablet for tablet 78324125f25849209703d17938a708ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:55 UTC) from {username='oryx', principal='oryx/127.30.35.253@KRBTEST.COM'} at 127.0.0.1:53012
I20260807 20:17:55.806461 10858 raft_consensus.cc:2229] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:17:55.806536 10858 raft_consensus.cc:2258] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:55.806612 10063 tablet_service.cc:1514] Processing DeleteTablet for tablet 78324125f25849209703d17938a708ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:55 UTC) from {username='oryx', principal='oryx/127.30.35.253@KRBTEST.COM'} at 127.0.0.1:55564
I20260807 20:17:55.806792 10861 tablet_replica.cc:330] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5: stopping tablet replica
I20260807 20:17:55.806878 10861 raft_consensus.cc:2229] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:55.806969 10858 ts_tablet_manager.cc:1905] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:55.806979 10861 raft_consensus.cc:2258] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:55.807514 10861 ts_tablet_manager.cc:1905] T 78324125f25849209703d17938a708ab P 3133b441314a4fbd91f4a74723f58cd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:55.807649 10859 tablet_replica.cc:330] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94: stopping tablet replica
I20260807 20:17:55.807705 10859 raft_consensus.cc:2229] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:55.807740 10859 raft_consensus.cc:2258] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:55.807757 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 9946
I20260807 20:17:55.816902 10858 ts_tablet_manager.cc:1918] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:55.816982 10858 log.cc:1196] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/78324125f25849209703d17938a708ab
I20260807 20:17:55.817211 10858 ts_tablet_manager.cc:1939] T 78324125f25849209703d17938a708ab P c33dc8adf30347d0851a35e14eab6d25: Deleting consensus metadata
W20260807 20:17:55.817677 9487 catalog_manager.cc:4808] TS c33dc8adf30347d0851a35e14eab6d25 (127.30.35.194:33857): delete failed for tablet 78324125f25849209703d17938a708ab because the tablet was not found. No further retry: Not found: Tablet not found: 78324125f25849209703d17938a708ab
I20260807 20:17:55.818046 10859 ts_tablet_manager.cc:1905] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:55.819816 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 10184
I20260807 20:17:55.819833 10775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:55.819734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:44223 (local address 127.0.0.1:55570)
0807 20:17:55.819777 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:55.819801 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:44223: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260807 20:17:55.822726 9487 catalog_manager.cc:4584] TS 3133b441314a4fbd91f4a74723f58cd5 (127.30.35.193:44223): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 78324125f25849209703d17938a708ab: Network error: Client connection negotiation failed: client connection to 127.30.35.193:44223: connect: Connection refused (error 111)
I20260807 20:17:55.827329 10859 ts_tablet_manager.cc:1918] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:55.827417 10859 log.cc:1196] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/78324125f25849209703d17938a708ab
I20260807 20:17:55.827669 10859 ts_tablet_manager.cc:1939] T 78324125f25849209703d17938a708ab P 8cc5e1d582b547908b99986dee2b2a94: Deleting consensus metadata
I20260807 20:17:55.827983 9487 catalog_manager.cc:4841] TS 8cc5e1d582b547908b99986dee2b2a94 (127.30.35.195:40203): tablet 78324125f25849209703d17938a708ab (table test-table [id=10ddde5eb48f487ebdcd7ca5f7a1019e]) successfully deleted
I20260807 20:17:55.831152 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 10421
I20260807 20:17:55.840029 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 9263
I20260807 20:17:55.849313 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 9600
2026-08-07T20:17:55Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5248 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:17:55 dist-test-slave-t7g5 krb5kdc[10865](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:17:55 dist-test-slave-t7g5 krb5kdc[10865](info): set up 2 sockets
Aug 07 20:17:55 dist-test-slave-t7g5 krb5kdc[10865](info): commencing operation
krb5kdc: starting...
W20260807 20:17:57.002571 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:17:57 dist-test-slave-t7g5 krb5kdc[10865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:17:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:57Z Disabled control of system clock
WARNING: no policy specified for oryx/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.254.keytab.
Entry for principal oryx/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.254.keytab.
I20260807 20:17:57.119819 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:37621
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.254.keytab
--principal=oryx/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:37621
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:57.200173 10889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:57.200380 10889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:57.200400 10889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:57.201526 10889 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:17:57.201566 10889 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 20:17:57.201578 10889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:57.201589 10889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:57.201601 10889 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:17:57.201613 10889 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:17:57.203138 10889 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:37621
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.254.keytab
--principal=oryx/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:37621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:57.203336 10889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:57.203523 10889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:57.208091 10902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:57.208186 10896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:57.208091 10897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:57.208317 10889 server_base.cc:1034] running on GCE node
I20260807 20:17:57.208588 10889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:57.208844 10889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:57.209975 10889 hybrid_clock.cc:648] HybridClock initialized: now 1786133877209959 us; error 32 us; skew 500 ppm
Aug 07 20:17:57 dist-test-slave-t7g5 krb5kdc[10865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133877, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:57.215219 10889 init.cc:377] Logged in from keytab as oryx/127.30.35.254@KRBTEST.COM (short username oryx)
I20260807 20:17:57.215649 10889 webserver.cc:460] Webserver started at http://127.30.35.254:35485/ using document root <none> and password file <none>
I20260807 20:17:57.215848 10889 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:57.215889 10889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:57.215983 10889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:57.216952 10889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "6681ec7b7c064c98a99b98ac06f49530"
format_stamp: "Formatted at 2026-08-07 20:17:57 on dist-test-slave-t7g5"
server_key: "a4f75c1c06fc45055af823299e684b9e"
server_key_iv: "d4577684a2aa03c691d8becf52da8365"
server_key_version: "encryptionkey@0"
I20260807 20:17:57.217244 10889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "6681ec7b7c064c98a99b98ac06f49530"
format_stamp: "Formatted at 2026-08-07 20:17:57 on dist-test-slave-t7g5"
server_key: "a4f75c1c06fc45055af823299e684b9e"
server_key_iv: "d4577684a2aa03c691d8becf52da8365"
server_key_version: "encryptionkey@0"
I20260807 20:17:57.218487 10889 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:17:57.219105 10913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:57.219255 10889 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:57.219341 10889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "6681ec7b7c064c98a99b98ac06f49530"
format_stamp: "Formatted at 2026-08-07 20:17:57 on dist-test-slave-t7g5"
server_key: "a4f75c1c06fc45055af823299e684b9e"
server_key_iv: "d4577684a2aa03c691d8becf52da8365"
server_key_version: "encryptionkey@0"
I20260807 20:17:57.219401 10889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:57.225968 10889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:57.227752 10889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:57.227896 10889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:57.232286 10889 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:37621
I20260807 20:17:57.232340 11025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:37621 every 8 connection(s)
I20260807 20:17:57.232633 10889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:17:57.233270 11026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:57.234658 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 10889
I20260807 20:17:57.234758 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:17:57.234957 30863 external_mini_cluster.cc:1428] Setting key 8edd76362cd66f2f70d20903b44261b4
I20260807 20:17:57.235868 11026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530: Bootstrap starting.
I20260807 20:17:57.236469 11026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:57.236792 11026 log.cc:824] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:57.237504 11026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530: No bootstrap required, opened a new log
I20260807 20:17:57.239616 11026 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6681ec7b7c064c98a99b98ac06f49530" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37621 } }
I20260807 20:17:57.239799 11026 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:57.239837 11026 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6681ec7b7c064c98a99b98ac06f49530, State: Initialized, Role: FOLLOWER
I20260807 20:17:57.239964 11026 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6681ec7b7c064c98a99b98ac06f49530" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37621 } }
I20260807 20:17:57.240032 11026 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:17:57.240052 11026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:17:57.240097 11026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:57.240741 11026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6681ec7b7c064c98a99b98ac06f49530" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37621 } }
I20260807 20:17:57.240860 11026 leader_election.cc:302] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6681ec7b7c064c98a99b98ac06f49530; no voters:
I20260807 20:17:57.241021 11026 leader_election.cc:288] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:17:57.241060 11033 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:57.241227 11033 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [term 1 LEADER]: Becoming Leader. State: Replica: 6681ec7b7c064c98a99b98ac06f49530, State: Running, Role: LEADER
I20260807 20:17:57.241284 11026 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:17:57.241338 11033 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6681ec7b7c064c98a99b98ac06f49530" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37621 } }
I20260807 20:17:57.241701 11033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6681ec7b7c064c98a99b98ac06f49530" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6681ec7b7c064c98a99b98ac06f49530" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37621 } } }
Aug 07 20:17:57 dist-test-slave-t7g5 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
I20260807 20:17:57.241845 11033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [sys.catalog]: This master's current role is: LEADER
I20260807 20:17:57.242005 11033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6681ec7b7c064c98a99b98ac06f49530. Latest consensus state: current_term: 1 leader_uuid: "6681ec7b7c064c98a99b98ac06f49530" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6681ec7b7c064c98a99b98ac06f49530" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37621 } } }
I20260807 20:17:57.242069 11033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530 [sys.catalog]: This master's current role is: LEADER
W20260807 20:17:57.243198 11060 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:17:57.243245 11060 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:17:57.243399 11049 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:17:57.243567 11049 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:17:57.244931 11049 catalog_manager.cc:1347] Generated new cluster ID: 0bf85b7df3a44bf0ae9e57a06d1236ac
I20260807 20:17:57.244985 11049 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:17:57.246184 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.235494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56062 (local address 127.30.35.254:37621)
0807 20:17:57.235643 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.235652 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.235676 (+ 24us) server_negotiation.cc:407] Connection header received
0807 20:17:57.236114 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.236121 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.236169 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.236282 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:57.237042 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.238080 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.239113 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.239490 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.239563 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.242420 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:57.242425 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:57.242425 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:57.242463 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:57.244370 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.244760 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.244763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.244764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.244874 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.245084 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.245085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.245085 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.245427 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:57.245596 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.245702 (+ 106us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.245967 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":60,"threads_started":1}
I20260807 20:17:57.252579 11049 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:17:57.253279 11049 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:17:57.265041 11049 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530: Generated new TSK 0
I20260807 20:17:57.265246 11049 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.193.keytab.
Entry for principal oryx/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.193.keytab.
I20260807 20:17:57.291918 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:37621
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.193.keytab
--principal=oryx/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:57.391590 11068 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:57.391794 11068 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:57.391816 11068 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:57.392928 11068 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:57.392969 11068 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:57.392988 11068 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 20:17:57.393018 11068 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:17:57.394522 11068 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.193.keytab
--principal=oryx/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.35.254:37621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11068
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:57.394737 11068 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:57.394968 11068 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:57.399726 11078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:57.399888 11068 server_base.cc:1034] running on GCE node
W20260807 20:17:57.399688 11084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:57.399689 11082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:57.400156 11068 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:57.400343 11068 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:57.401472 11068 hybrid_clock.cc:648] HybridClock initialized: now 1786133877401460 us; error 29 us; skew 500 ppm
Aug 07 20:17:57 dist-test-slave-t7g5 krb5kdc[10865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133877, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:57.404001 11068 init.cc:377] Logged in from keytab as oryx/127.30.35.193@KRBTEST.COM (short username oryx)
I20260807 20:17:57.404435 11068 webserver.cc:460] Webserver started at http://127.30.35.193:33079/ using document root <none> and password file <none>
I20260807 20:17:57.404629 11068 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:57.404675 11068 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:57.404795 11068 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:57.405845 11068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "95589b14f4d84d6d89f09925c5d9b714"
format_stamp: "Formatted at 2026-08-07 20:17:57 on dist-test-slave-t7g5"
server_key: "ad084f8127cd30280f99eedafb3efa51"
server_key_iv: "75b03c7a8a8a5891426ceb38f2276096"
server_key_version: "encryptionkey@0"
I20260807 20:17:57.406172 11068 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "95589b14f4d84d6d89f09925c5d9b714"
format_stamp: "Formatted at 2026-08-07 20:17:57 on dist-test-slave-t7g5"
server_key: "ad084f8127cd30280f99eedafb3efa51"
server_key_iv: "75b03c7a8a8a5891426ceb38f2276096"
server_key_version: "encryptionkey@0"
I20260807 20:17:57.407371 11068 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:57.408010 11098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:57.408164 11068 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:57.408246 11068 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "95589b14f4d84d6d89f09925c5d9b714"
format_stamp: "Formatted at 2026-08-07 20:17:57 on dist-test-slave-t7g5"
server_key: "ad084f8127cd30280f99eedafb3efa51"
server_key_iv: "75b03c7a8a8a5891426ceb38f2276096"
server_key_version: "encryptionkey@0"
I20260807 20:17:57.408305 11068 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:57.416354 11068 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:57.418385 11068 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:57.418521 11068 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:57.419009 11068 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:57.419049 11068 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:57.419075 11068 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:57.419099 11068 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 20:17:57 dist-test-slave-t7g5 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133877, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
I20260807 20:17:57.426270 11068 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:33249
I20260807 20:17:57.426345 11279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:33249 every 8 connection(s)
I20260807 20:17:57.426676 11068 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:17:57.427131 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 11068
I20260807 20:17:57.427244 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:17:57.427480 30863 external_mini_cluster.cc:1428] Setting key 872265ab0de71a0225b3c4f0d114d07b
I20260807 20:17:57.428740 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.419348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:59587 (local address 127.30.35.254:37621)
0807 20:17:57.419407 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.419409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.419620 (+ 211us) server_negotiation.cc:407] Connection header received
0807 20:17:57.420249 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.420250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.420260 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.420321 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:57.421170 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.421888 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.422977 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.423232 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.423290 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.425782 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:57.425784 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:57.425784 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:57.425790 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:57.427302 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.427784 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.427785 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.427786 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.427854 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.428123 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.428124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.428124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.428253 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:57.428331 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.428562 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.428653 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 20:17:57.428807 11111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.419332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:37621 (local address 127.30.35.193:59587)
0807 20:17:57.419486 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:57.419533 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:57.420152 (+ 619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:57.420407 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:57.420412 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:57.420767 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:57.421068 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.421075 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.422011 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.422012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.422895 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.422898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.423328 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.423329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.423472 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.423943 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:57.423955 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:57.425688 (+ 1733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:57.427388 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:57.427396 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:57.427398 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:57.427695 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:57.427912 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:57.427913 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:57.427913 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:57.428058 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:57.428319 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:57.428323 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:57.428442 (+ 119us) client_negotiation.cc:769] Sending connection context
0807 20:17:57.428525 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 20:17:57.428649 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260807 20:17:57.429284 11281 heartbeater.cc:347] Connected to a master server at 127.30.35.254:37621
I20260807 20:17:57.429368 11281 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:57.429581 11281 heartbeater.cc:511] Master 127.30.35.254:37621 requested a full tablet report, sending...
I20260807 20:17:57.430173 10938 ts_manager.cc:194] Registered new tserver with Master: 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249)
I20260807 20:17:57.431018 10938 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:59587
I20260807 20:17:57.436905 11292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.430201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:37621 (local address 127.30.35.193:54251)
0807 20:17:57.431712 (+ 1511us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:57.431723 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:57.431797 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:57.431924 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:57.431925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:57.432078 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:57.432126 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.432127 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.432927 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.432928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.433474 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.433476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.433926 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.433926 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.433974 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.434356 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:57.434360 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:57.434624 (+ 264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:57.436091 (+ 1467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:57.436092 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:57.436093 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:57.436244 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:57.436419 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:57.436419 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:57.436420 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:57.436476 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:57.436699 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:57.436700 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:57.436733 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 20:17:57.436776 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 20:17:57.436844 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1487,"thread_start_us":74,"threads_started":1}
I20260807 20:17:57.436954 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.430268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:54251 (local address 127.30.35.254:37621)
0807 20:17:57.431220 (+ 952us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.431222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.431791 (+ 569us) server_negotiation.cc:407] Connection header received
0807 20:17:57.431852 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.431853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.431863 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.431910 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:57.432186 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.432846 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.433555 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.433859 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.433932 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.434704 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:57.434705 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:57.434706 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:57.434713 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:57.436020 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.436306 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.436308 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.436308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.436359 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.436525 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.436526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.436526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.436644 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:57.436713 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.436806 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.436872 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":935}
WARNING: no policy specified for oryx/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.194.keytab.
Entry for principal oryx/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.194.keytab.
I20260807 20:17:57.451956 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:37621
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.194.keytab
--principal=oryx/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:57.531025 11296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:57.531252 11296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:57.531286 11296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:57.532392 11296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:57.532433 11296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:57.532461 11296 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 20:17:57.532482 11296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:17:57.533950 11296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.194.keytab
--principal=oryx/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.35.254:37621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:57.534168 11296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:57.534368 11296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:57.539032 11306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:57.539057 11307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:57.539057 11310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:57.539253 11296 server_base.cc:1034] running on GCE node
I20260807 20:17:57.539445 11296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:57.539646 11296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:57.540799 11296 hybrid_clock.cc:648] HybridClock initialized: now 1786133877540781 us; error 27 us; skew 500 ppm
Aug 07 20:17:57 dist-test-slave-t7g5 krb5kdc[10865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133877, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:57.543157 11296 init.cc:377] Logged in from keytab as oryx/127.30.35.194@KRBTEST.COM (short username oryx)
I20260807 20:17:57.543573 11296 webserver.cc:460] Webserver started at http://127.30.35.194:45049/ using document root <none> and password file <none>
I20260807 20:17:57.543764 11296 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:57.543812 11296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:57.543939 11296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:57.544907 11296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "31ed92fd8fd846e38674824c1ac0021a"
format_stamp: "Formatted at 2026-08-07 20:17:57 on dist-test-slave-t7g5"
server_key: "929aaf40d61b8e6dafca9e2a6f747fa9"
server_key_iv: "ffc53bd95d9114523a2ebb1d9e5bd5a8"
server_key_version: "encryptionkey@0"
I20260807 20:17:57.545239 11296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "31ed92fd8fd846e38674824c1ac0021a"
format_stamp: "Formatted at 2026-08-07 20:17:57 on dist-test-slave-t7g5"
server_key: "929aaf40d61b8e6dafca9e2a6f747fa9"
server_key_iv: "ffc53bd95d9114523a2ebb1d9e5bd5a8"
server_key_version: "encryptionkey@0"
I20260807 20:17:57.546497 11296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:17:57.547112 11318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:57.547262 11296 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:17:57.547343 11296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "31ed92fd8fd846e38674824c1ac0021a"
format_stamp: "Formatted at 2026-08-07 20:17:57 on dist-test-slave-t7g5"
server_key: "929aaf40d61b8e6dafca9e2a6f747fa9"
server_key_iv: "ffc53bd95d9114523a2ebb1d9e5bd5a8"
server_key_version: "encryptionkey@0"
I20260807 20:17:57.547399 11296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:57.578910 11296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:57.580677 11296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:57.580813 11296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:57.581326 11296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:57.581369 11296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:57.581399 11296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:57.581416 11296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 20:17:57 dist-test-slave-t7g5 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133877, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
I20260807 20:17:57.588223 11296 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:33531
I20260807 20:17:57.588299 11502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:33531 every 8 connection(s)
I20260807 20:17:57.588619 11296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:17:57.590495 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.581830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:38909 (local address 127.30.35.254:37621)
0807 20:17:57.581885 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.581887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.582111 (+ 224us) server_negotiation.cc:407] Connection header received
0807 20:17:57.582619 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.582620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.582633 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.582704 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:57.583382 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.583889 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.584856 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.585053 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.585108 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.587976 (+ 2868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:57.587977 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:57.587978 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:57.587985 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:57.589401 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.589772 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.589773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.589774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.589826 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.590014 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.590015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.590015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.590114 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:57.590157 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.590367 (+ 210us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.590434 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 20:17:57.590656 11332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.581849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:37621 (local address 127.30.35.194:38909)
0807 20:17:57.581999 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:57.582035 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:57.582522 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:57.582792 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:57.582796 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:57.583102 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:57.583291 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.583296 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.583979 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.583980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.584776 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.584778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.585122 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.585122 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.585255 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.585779 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:57.585790 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:57.587887 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:57.589471 (+ 1584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:57.589474 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:57.589476 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:57.589720 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:57.589872 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:57.589873 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:57.589873 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:57.589977 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:57.590153 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:57.590157 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:57.590270 (+ 113us) client_negotiation.cc:769] Sending connection context
0807 20:17:57.590346 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 20:17:57.590462 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
I20260807 20:17:57.591094 11503 heartbeater.cc:347] Connected to a master server at 127.30.35.254:37621
I20260807 20:17:57.591176 11503 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:57.591362 11503 heartbeater.cc:511] Master 127.30.35.254:37621 requested a full tablet report, sending...
I20260807 20:17:57.591725 10939 ts_manager.cc:194] Registered new tserver with Master: 31ed92fd8fd846e38674824c1ac0021a (127.30.35.194:33531)
I20260807 20:17:57.592099 10939 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:38909
I20260807 20:17:57.596390 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 11296
I20260807 20:17:57.596520 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:17:57.596616 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.592119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:44591 (local address 127.30.35.254:37621)
0807 20:17:57.592156 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.592157 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.592231 (+ 74us) server_negotiation.cc:407] Connection header received
0807 20:17:57.592282 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.592283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.592293 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.592354 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:57.592707 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.593147 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.593805 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.593981 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.594021 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.594744 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:57.594745 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:57.594745 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:57.594749 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:57.595712 (+ 963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.595976 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.595977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.595977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.596018 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.596135 (+ 117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.596135 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.596135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.596251 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:57.596304 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.596456 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.596528 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:17:57.596632 11510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.592051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:37621 (local address 127.30.35.194:44591)
0807 20:17:57.592163 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:57.592173 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:57.592227 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:57.592359 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:57.592359 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:57.592570 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:57.592632 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.592634 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.593217 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.593218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.593742 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.593744 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.594027 (+ 283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.594027 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.594069 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.594420 (+ 351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:57.594425 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:57.594689 (+ 264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:57.595769 (+ 1080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:57.595770 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:57.595770 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:57.595919 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:57.596057 (+ 138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:57.596058 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:57.596058 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:57.596102 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:57.596319 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:57.596320 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:57.596364 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 20:17:57.596432 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 20:17:57.596528 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":66,"threads_started":1}
I20260807 20:17:57.596689 30863 external_mini_cluster.cc:1428] Setting key b8b0856afc31a44785e0b400455e5583
WARNING: no policy specified for oryx/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.195.keytab.
Entry for principal oryx/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.195.keytab.
I20260807 20:17:57.620333 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:37621
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.195.keytab
--principal=oryx/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:17:57.700920 11517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:17:57.701120 11517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:17:57.701143 11517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:17:57.702234 11517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:17:57.702268 11517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:17:57.702286 11517 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 20:17:57.702308 11517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:17:57.703822 11517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.195.keytab
--principal=oryx/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.30.35.254:37621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:17:57.704003 11517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:17:57.704176 11517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:17:57.708782 11527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:57.708845 11517 server_base.cc:1034] running on GCE node
W20260807 20:17:57.708781 11524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:17:57.708813 11523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:17:57.709208 11517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:17:57.709424 11517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:17:57.710557 11517 hybrid_clock.cc:648] HybridClock initialized: now 1786133877710539 us; error 35 us; skew 500 ppm
Aug 07 20:17:57 dist-test-slave-t7g5 krb5kdc[10865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133877, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:17:57.712941 11517 init.cc:377] Logged in from keytab as oryx/127.30.35.195@KRBTEST.COM (short username oryx)
I20260807 20:17:57.713327 11517 webserver.cc:460] Webserver started at http://127.30.35.195:39529/ using document root <none> and password file <none>
I20260807 20:17:57.713528 11517 fs_manager.cc:359] Metadata directory not provided
I20260807 20:17:57.713572 11517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:17:57.713722 11517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:17:57.714704 11517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "9c9a58b62f3140cb9389f15cb9e82c2c"
format_stamp: "Formatted at 2026-08-07 20:17:57 on dist-test-slave-t7g5"
server_key: "e841779385ce2ef8bacf9975f59603b5"
server_key_iv: "32de37a94500433fc6b071d8353422de"
server_key_version: "encryptionkey@0"
I20260807 20:17:57.715029 11517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "9c9a58b62f3140cb9389f15cb9e82c2c"
format_stamp: "Formatted at 2026-08-07 20:17:57 on dist-test-slave-t7g5"
server_key: "e841779385ce2ef8bacf9975f59603b5"
server_key_iv: "32de37a94500433fc6b071d8353422de"
server_key_version: "encryptionkey@0"
I20260807 20:17:57.716259 11517 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:17:57.716864 11535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:57.717027 11517 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:57.717110 11517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "9c9a58b62f3140cb9389f15cb9e82c2c"
format_stamp: "Formatted at 2026-08-07 20:17:57 on dist-test-slave-t7g5"
server_key: "e841779385ce2ef8bacf9975f59603b5"
server_key_iv: "32de37a94500433fc6b071d8353422de"
server_key_version: "encryptionkey@0"
I20260807 20:17:57.717161 11517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:17:57.726655 11517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:17:57.728284 11517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:17:57.728389 11517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:17:57.728868 11517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:17:57.728909 11517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:57.728927 11517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:17:57.728950 11517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:57.735054 11517 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:35777
I20260807 20:17:57.735131 11735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:35777 every 8 connection(s)
Aug 07 20:17:57 dist-test-slave-t7g5 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133877, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
I20260807 20:17:57.735491 11517 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:17:57.738147 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.729248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:33085 (local address 127.30.35.254:37621)
0807 20:17:57.729307 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.729310 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.729483 (+ 173us) server_negotiation.cc:407] Connection header received
0807 20:17:57.729995 (+ 512us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.729997 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.730009 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.730091 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:57.730893 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.731648 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.733079 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.733362 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.733434 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.735842 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:57.735844 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:57.735844 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:57.735852 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:57.736949 (+ 1097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.737282 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.737282 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.737283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.737328 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.737549 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.737549 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.737549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.737639 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:57.737726 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.737980 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.738061 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 20:17:57.738291 11558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.729214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:37621 (local address 127.30.35.195:33085)
0807 20:17:57.729364 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:57.729403 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:57.729883 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:57.730165 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:57.730173 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:57.730524 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:57.730795 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.730801 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.731763 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.731764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.732990 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.732992 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.733442 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.733443 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.733538 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.734042 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:57.734051 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:57.735739 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:57.737011 (+ 1272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:57.737017 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:57.737019 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:57.737223 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:57.737376 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:57.737377 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:57.737377 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:57.737502 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:57.737718 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:57.737725 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:57.737857 (+ 132us) client_negotiation.cc:769] Sending connection context
0807 20:17:57.737953 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 20:17:57.738095 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":84,"threads_started":1}
I20260807 20:17:57.738721 11736 heartbeater.cc:347] Connected to a master server at 127.30.35.254:37621
I20260807 20:17:57.738799 11736 heartbeater.cc:464] Registering TS with master...
I20260807 20:17:57.738965 11736 heartbeater.cc:511] Master 127.30.35.254:37621 requested a full tablet report, sending...
I20260807 20:17:57.739328 10939 ts_manager.cc:194] Registered new tserver with Master: 9c9a58b62f3140cb9389f15cb9e82c2c (127.30.35.195:35777)
I20260807 20:17:57.739774 10939 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:33085
I20260807 20:17:57.744411 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.739669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:48203 (local address 127.30.35.254:37621)
0807 20:17:57.739705 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.739707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.739830 (+ 123us) server_negotiation.cc:407] Connection header received
0807 20:17:57.739855 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.739856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.739865 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.739946 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:57.740269 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.740720 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.741416 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.741595 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.741645 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.742519 (+ 874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:57.742520 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:57.742520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:57.742526 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:57.743617 (+ 1091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.743912 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.743912 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.743913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.743957 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.744085 (+ 128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.744086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.744086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.744165 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:57.744215 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.744305 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.744356 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 20:17:57.744424 11745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.739608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:37621 (local address 127.30.35.195:48203)
0807 20:17:57.739761 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:57.739770 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:57.739820 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:57.739952 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:57.739952 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:57.740146 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:57.740197 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.740199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.740807 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.740807 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.741344 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.741345 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.741670 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.741671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.741732 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.742090 (+ 358us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:57.742095 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:57.742428 (+ 333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:57.743679 (+ 1251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:57.743680 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:57.743681 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:57.743853 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:57.743999 (+ 146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:57.743999 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:57.743999 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:57.744047 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:57.744211 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:57.744211 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:57.744244 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 20:17:57.744287 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 20:17:57.744357 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":77,"threads_started":1}
I20260807 20:17:57.745321 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 11517
I20260807 20:17:57.745428 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:17:57.745617 30863 external_mini_cluster.cc:1428] Setting key c26b5db9afe404d290e5b35fdfbc299f
I20260807 20:17:57.746407 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 20:17:57 dist-test-slave-t7g5 krb5kdc[10865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133877, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 20:17:57 dist-test-slave-t7g5 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:17:57 dist-test-slave-t7g5 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 20:17:57.766994 11030 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:17:57.762283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56072 (local address 127.30.35.254:37621)
0807 20:17:57.762334 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.762335 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.762343 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:57.762388 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.762389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.762397 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.762450 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:57.762941 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.763404 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.764061 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.764226 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.764264 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.766917 (+ 2653us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56072: BlockingRecv error: recv got EOF from 127.0.0.1:56072 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 07 20:17:57 dist-test-slave-t7g5 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133877, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
I20260807 20:17:57.773207 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.767708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56076 (local address 127.30.35.254:37621)
0807 20:17:57.767751 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.767753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.767826 (+ 73us) server_negotiation.cc:407] Connection header received
0807 20:17:57.767866 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.767866 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.767874 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.767916 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:57.768305 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.768744 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.769313 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.769482 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.769521 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.771290 (+ 1769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:57.771291 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:57.771291 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:57.771297 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:57.772494 (+ 1197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.772728 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.772728 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.772729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.772773 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.772884 (+ 111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.772884 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.772885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.772970 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:57.773035 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.773097 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.773148 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 20:17:57.774602 10939 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:17:57.776211 10939 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:57.782145 11773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.778312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:33531 (local address 127.0.0.1:40156)
0807 20:17:57.778482 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:57.778825 (+ 343us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:57.778861 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:57.779063 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:57.779063 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:57.779065 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:57.779098 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.779099 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.780314 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.780315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.781130 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.781133 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.781859 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.781860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.781936 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.781949 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 20:17:57.782019 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 20:17:57.782068 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":25,"thread_start_us":56,"threads_started":1}
I20260807 20:17:57.782162 11776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.778438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40156 (local address 127.30.35.194:33531)
0807 20:17:57.778620 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.778625 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.778867 (+ 242us) server_negotiation.cc:407] Connection header received
0807 20:17:57.778911 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.778913 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.778929 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.779002 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:57.779177 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.780204 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.781226 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.781789 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.781851 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.781938 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.782034 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.782073 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":100,"threads_started":1}
I20260807 20:17:57.782485 11777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.778561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51464 (local address 127.30.35.195:35777)
0807 20:17:57.778714 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.778718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.778730 (+ 12us) server_negotiation.cc:407] Connection header received
0807 20:17:57.778803 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.778806 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.778822 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.778901 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:57.779108 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.779840 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.781147 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.781881 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.781954 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.782022 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.782353 (+ 331us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.782396 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":87,"threads_started":1}
I20260807 20:17:57.782493 11772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.778318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:33249 (local address 127.0.0.1:56174)
0807 20:17:57.778727 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:57.778736 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:57.778773 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:57.778944 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:57.778947 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:57.778949 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:57.779012 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.779014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.780304 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.780305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.781371 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.781373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.782288 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.782289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.782348 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.782352 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:57.782399 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 20:17:57.782432 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":34,"thread_start_us":80,"threads_started":1}
I20260807 20:17:57.782550 11782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.778580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56174 (local address 127.30.35.193:33249)
0807 20:17:57.778757 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.778761 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.778770 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:17:57.778852 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.778854 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.778867 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.778936 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:57.779092 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.780222 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.781465 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.782208 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.782267 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.782338 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.782408 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.782455 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":81,"threads_started":1}
I20260807 20:17:57.782282 11771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.778318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:35777 (local address 127.0.0.1:51464)
0807 20:17:57.778617 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:57.778648 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:57.778712 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:57.778968 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:57.778969 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:57.778972 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:57.779028 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.779030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.779915 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.779916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.781057 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.781060 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.782058 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.782059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.782121 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.782125 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:57.782173 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 20:17:57.782210 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":85,"threads_started":1}
I20260807 20:17:57.783174 11396 tablet_service.cc:1467] Processing CreateTablet for tablet b4ef5bbf5530423a9035d4d353f705c1 (DEFAULT_TABLE table=test-table [id=f946735d9b8e4b568ce48439e8269742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:57.783576 11396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4ef5bbf5530423a9035d4d353f705c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:57.783583 11619 tablet_service.cc:1467] Processing CreateTablet for tablet b4ef5bbf5530423a9035d4d353f705c1 (DEFAULT_TABLE table=test-table [id=f946735d9b8e4b568ce48439e8269742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:57.783923 11619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4ef5bbf5530423a9035d4d353f705c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:57.786684 11787 tablet_bootstrap.cc:492] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a: Bootstrap starting.
I20260807 20:17:57.787166 11182 tablet_service.cc:1467] Processing CreateTablet for tablet b4ef5bbf5530423a9035d4d353f705c1 (DEFAULT_TABLE table=test-table [id=f946735d9b8e4b568ce48439e8269742]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:57.787360 11787 tablet_bootstrap.cc:654] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:57.787505 11182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4ef5bbf5530423a9035d4d353f705c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:57.787684 11787 log.cc:824] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:57.788012 11783 tablet_bootstrap.cc:492] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c: Bootstrap starting.
I20260807 20:17:57.788633 11783 tablet_bootstrap.cc:654] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:57.788941 11783 log.cc:824] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:57.789499 11787 tablet_bootstrap.cc:492] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a: No bootstrap required, opened a new log
I20260807 20:17:57.789604 11783 tablet_bootstrap.cc:492] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c: No bootstrap required, opened a new log
I20260807 20:17:57.789639 11787 ts_tablet_manager.cc:1397] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 20:17:57.789736 11783 ts_tablet_manager.cc:1397] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:17:57.791250 11794 tablet_bootstrap.cc:492] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714: Bootstrap starting.
I20260807 20:17:57.791270 11783 raft_consensus.cc:348] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.791429 11783 raft_consensus.cc:374] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:57.791507 11783 raft_consensus.cc:729] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c9a58b62f3140cb9389f15cb9e82c2c, State: Initialized, Role: FOLLOWER
I20260807 20:17:57.791640 11783 consensus_queue.cc:260] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.791792 11787 raft_consensus.cc:348] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.791901 11783 ts_tablet_manager.cc:1428] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:17:57.791934 11787 raft_consensus.cc:374] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:57.791965 11787 raft_consensus.cc:729] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ed92fd8fd846e38674824c1ac0021a, State: Initialized, Role: FOLLOWER
I20260807 20:17:57.791960 11794 tablet_bootstrap.cc:654] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:57.792128 11736 heartbeater.cc:503] Master 127.30.35.254:37621 was elected leader, sending a full tablet report...
I20260807 20:17:57.792109 11787 consensus_queue.cc:260] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.792362 11787 ts_tablet_manager.cc:1428] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 20:17:57.792397 11503 heartbeater.cc:503] Master 127.30.35.254:37621 was elected leader, sending a full tablet report...
I20260807 20:17:57.792347 11794 log.cc:824] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714: Log is configured to *not* fsync() on all Append() calls
I20260807 20:17:57.793322 11794 tablet_bootstrap.cc:492] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714: No bootstrap required, opened a new log
I20260807 20:17:57.793395 11794 ts_tablet_manager.cc:1397] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:57.794816 11794 raft_consensus.cc:348] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.794943 11794 raft_consensus.cc:374] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:57.794965 11794 raft_consensus.cc:729] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95589b14f4d84d6d89f09925c5d9b714, State: Initialized, Role: FOLLOWER
I20260807 20:17:57.795068 11794 consensus_queue.cc:260] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.795281 11794 ts_tablet_manager.cc:1428] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:17:57.795332 11281 heartbeater.cc:503] Master 127.30.35.254:37621 was elected leader, sending a full tablet report...
I20260807 20:17:57.825348 11798 raft_consensus.cc:482] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:57.825481 11798 raft_consensus.cc:504] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.825822 11798 leader_election.cc:288] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249), 9c9a58b62f3140cb9389f15cb9e82c2c (127.30.35.195:35777)
I20260807 20:17:57.828493 11782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.826103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:59251 (local address 127.30.35.193:33249)
0807 20:17:57.826143 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.826145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.826297 (+ 152us) server_negotiation.cc:407] Connection header received
0807 20:17:57.826327 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.826328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.826337 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.826390 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:57.826523 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.826981 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.827850 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.828187 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.828245 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.828254 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.828396 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.828427 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 20:17:57.828516 11777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.826042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:47053 (local address 127.30.35.195:35777)
0807 20:17:57.826087 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.826089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.826099 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:17:57.826167 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.826168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.826178 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.826241 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:57.826391 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.826896 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.827842 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.828189 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.828248 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.828256 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.828406 (+ 150us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.828444 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:17:57.828552 11801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.825990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:33249 (local address 127.30.35.194:59251)
0807 20:17:57.826225 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:57.826234 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:57.826290 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:57.826397 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:57.826398 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:57.826399 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:57.826467 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.826468 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.827048 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.827049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.827766 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.827767 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.828257 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.828258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.828331 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.828335 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:57.828377 (+ 42us) client_negotiation.cc:240] Negotiation successful
0807 20:17:57.828414 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":75,"thread_start_us":97,"threads_started":1}
I20260807 20:17:57.828558 11332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.825990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:35777 (local address 127.30.35.194:47053)
0807 20:17:57.826048 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:57.826062 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:57.826111 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:57.826244 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:57.826245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:57.826246 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:57.826325 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.826327 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.826967 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.826968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.827758 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.827760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.828260 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.828260 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.828343 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.828346 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:57.828395 (+ 49us) client_negotiation.cc:240] Negotiation successful
0807 20:17:57.828431 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":22}
I20260807 20:17:57.828891 11202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4ef5bbf5530423a9035d4d353f705c1" candidate_uuid: "31ed92fd8fd846e38674824c1ac0021a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95589b14f4d84d6d89f09925c5d9b714" is_pre_election: true
I20260807 20:17:57.829046 11202 raft_consensus.cc:2454] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ed92fd8fd846e38674824c1ac0021a in term 0.
I20260807 20:17:57.829252 11321 leader_election.cc:302] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ed92fd8fd846e38674824c1ac0021a, 95589b14f4d84d6d89f09925c5d9b714; no voters:
I20260807 20:17:57.829282 11655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4ef5bbf5530423a9035d4d353f705c1" candidate_uuid: "31ed92fd8fd846e38674824c1ac0021a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" is_pre_election: true
I20260807 20:17:57.829384 11798 raft_consensus.cc:2781] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:57.829412 11655 raft_consensus.cc:2454] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ed92fd8fd846e38674824c1ac0021a in term 0.
I20260807 20:17:57.829438 11798 raft_consensus.cc:482] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:57.829470 11798 raft_consensus.cc:3037] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:57.830554 11798 raft_consensus.cc:504] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.830674 11798 leader_election.cc:288] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [CANDIDATE]: Term 1 election: Requested vote from peers 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249), 9c9a58b62f3140cb9389f15cb9e82c2c (127.30.35.195:35777)
I20260807 20:17:57.830847 11202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4ef5bbf5530423a9035d4d353f705c1" candidate_uuid: "31ed92fd8fd846e38674824c1ac0021a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95589b14f4d84d6d89f09925c5d9b714"
I20260807 20:17:57.830860 11655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4ef5bbf5530423a9035d4d353f705c1" candidate_uuid: "31ed92fd8fd846e38674824c1ac0021a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c"
I20260807 20:17:57.830919 11655 raft_consensus.cc:3037] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:57.830927 11202 raft_consensus.cc:3037] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:57.831532 11655 raft_consensus.cc:2454] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ed92fd8fd846e38674824c1ac0021a in term 1.
I20260807 20:17:57.831593 11202 raft_consensus.cc:2454] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ed92fd8fd846e38674824c1ac0021a in term 1.
I20260807 20:17:57.831694 11322 leader_election.cc:302] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ed92fd8fd846e38674824c1ac0021a, 9c9a58b62f3140cb9389f15cb9e82c2c; no voters:
I20260807 20:17:57.831784 11798 raft_consensus.cc:2781] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:57.831925 11798 raft_consensus.cc:686] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [term 1 LEADER]: Becoming Leader. State: Replica: 31ed92fd8fd846e38674824c1ac0021a, State: Running, Role: LEADER
I20260807 20:17:57.832005 11798 consensus_queue.cc:237] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.832739 10939 catalog_manager.cc:5495] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31ed92fd8fd846e38674824c1ac0021a (127.30.35.194). New cstate: current_term: 1 leader_uuid: "31ed92fd8fd846e38674824c1ac0021a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } health_report { overall_health: UNKNOWN } } }
I20260807 20:17:57.838275 11776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.836378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40164 (local address 127.30.35.194:33531)
0807 20:17:57.836427 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.836428 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.836435 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:17:57.836462 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.836463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.836476 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.836532 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:57.836633 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.837049 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.837724 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.837890 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.837933 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.838044 (+ 111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:57.838126 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:57.838195 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.838208 (+ 13us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.838223 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
W20260807 20:17:57.839679 11505 tablet.cc:2369] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:17:57.839747 11202 raft_consensus.cc:1261] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Refusing update from remote peer 31ed92fd8fd846e38674824c1ac0021a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:57.839771 11655 raft_consensus.cc:1261] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Refusing update from remote peer 31ed92fd8fd846e38674824c1ac0021a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:57.840029 11798 consensus_queue.cc:1035] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [LEADER]: Connected to new peer: Peer: permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:57.840147 11802 consensus_queue.cc:1035] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:57.842499 11812 mvcc.cc:205] Tried to move back new op lower bound from 7316004363629551616 to 7316004363600461824. Current Snapshot: MvccSnapshot[applied={T|T < 7316004363629551616}]
I20260807 20:17:57.844754 10939 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:57.844830 10939 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:57.845491 10939 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530: Sending DeleteTablet for 3 replicas of tablet b4ef5bbf5530423a9035d4d353f705c1
I20260807 20:17:57.845777 11396 tablet_service.cc:1514] Processing DeleteTablet for tablet b4ef5bbf5530423a9035d4d353f705c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:57 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:40156
I20260807 20:17:57.845824 11619 tablet_service.cc:1514] Processing DeleteTablet for tablet b4ef5bbf5530423a9035d4d353f705c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:57 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:51464
I20260807 20:17:57.846010 11182 tablet_service.cc:1514] Processing DeleteTablet for tablet b4ef5bbf5530423a9035d4d353f705c1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:57 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:56174
I20260807 20:17:57.846047 11826 tablet_replica.cc:330] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c: stopping tablet replica
I20260807 20:17:57.846145 11826 raft_consensus.cc:2229] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:57.846244 11826 raft_consensus.cc:2258] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:57.846307 10939 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56076:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 20:17:57.846390 11829 tablet_replica.cc:330] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714: stopping tablet replica
W20260807 20:17:57.846457 10939 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:57.846470 11829 raft_consensus.cc:2229] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:57.846478 11828 tablet_replica.cc:330] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a: stopping tablet replica
I20260807 20:17:57.846561 11828 raft_consensus.cc:2229] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:17:57.846561 11829 raft_consensus.cc:2258] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:57.846660 11828 raft_consensus.cc:2258] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:57.847112 11829 ts_tablet_manager.cc:1905] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:57.847107 11828 ts_tablet_manager.cc:1905] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:57.847886 11396 tablet_service.cc:1467] Processing CreateTablet for tablet 6e718f741d0b45bcaae688bbb2f02319 (DEFAULT_TABLE table=test-table [id=6a6b08d1f4d94f22ba5e2bee63c4c489]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:57.848007 11619 tablet_service.cc:1467] Processing CreateTablet for tablet 6e718f741d0b45bcaae688bbb2f02319 (DEFAULT_TABLE table=test-table [id=6a6b08d1f4d94f22ba5e2bee63c4c489]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:57.848054 11396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e718f741d0b45bcaae688bbb2f02319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:57.848093 11619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e718f741d0b45bcaae688bbb2f02319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:57.848860 11828 ts_tablet_manager.cc:1918] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:57.848923 11828 log.cc:1196] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/b4ef5bbf5530423a9035d4d353f705c1
I20260807 20:17:57.849186 11828 ts_tablet_manager.cc:1939] T b4ef5bbf5530423a9035d4d353f705c1 P 31ed92fd8fd846e38674824c1ac0021a: Deleting consensus metadata
I20260807 20:17:57.849337 11182 tablet_service.cc:1467] Processing CreateTablet for tablet 6e718f741d0b45bcaae688bbb2f02319 (DEFAULT_TABLE table=test-table [id=6a6b08d1f4d94f22ba5e2bee63c4c489]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:57.849427 11182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e718f741d0b45bcaae688bbb2f02319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:57.849464 11783 tablet_bootstrap.cc:492] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c: Bootstrap starting.
I20260807 20:17:57.849882 11783 tablet_bootstrap.cc:654] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:57.850467 11783 tablet_bootstrap.cc:492] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c: No bootstrap required, opened a new log
I20260807 20:17:57.850509 11783 ts_tablet_manager.cc:1397] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 20:17:57.850675 11783 raft_consensus.cc:348] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.850721 11794 tablet_bootstrap.cc:492] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714: Bootstrap starting.
I20260807 20:17:57.850750 11783 raft_consensus.cc:374] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:57.850772 11783 raft_consensus.cc:729] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c9a58b62f3140cb9389f15cb9e82c2c, State: Initialized, Role: FOLLOWER
I20260807 20:17:57.850807 11787 tablet_bootstrap.cc:492] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a: Bootstrap starting.
I20260807 20:17:57.850823 11783 consensus_queue.cc:260] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.850904 11783 ts_tablet_manager.cc:1428] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:57.851112 11794 tablet_bootstrap.cc:654] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:57.851181 11787 tablet_bootstrap.cc:654] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:57.851577 11826 ts_tablet_manager.cc:1905] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:57.851703 11787 tablet_bootstrap.cc:492] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a: No bootstrap required, opened a new log
I20260807 20:17:57.851747 11787 ts_tablet_manager.cc:1397] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 20:17:57.851876 10914 catalog_manager.cc:4841] TS 31ed92fd8fd846e38674824c1ac0021a (127.30.35.194:33531): tablet b4ef5bbf5530423a9035d4d353f705c1 (table test-table [id=f946735d9b8e4b568ce48439e8269742]) successfully deleted
I20260807 20:17:57.851902 11787 raft_consensus.cc:348] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.851958 11787 raft_consensus.cc:374] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:57.851975 11787 raft_consensus.cc:729] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ed92fd8fd846e38674824c1ac0021a, State: Initialized, Role: FOLLOWER
I20260807 20:17:57.852012 11787 consensus_queue.cc:260] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.852087 11787 ts_tablet_manager.cc:1428] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:57.852988 11826 ts_tablet_manager.cc:1918] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:57.853066 11826 log.cc:1196] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/b4ef5bbf5530423a9035d4d353f705c1
I20260807 20:17:57.853237 11829 ts_tablet_manager.cc:1918] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:57.853314 11829 log.cc:1196] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/wal/wals/b4ef5bbf5530423a9035d4d353f705c1
I20260807 20:17:57.853360 11826 ts_tablet_manager.cc:1939] T b4ef5bbf5530423a9035d4d353f705c1 P 9c9a58b62f3140cb9389f15cb9e82c2c: Deleting consensus metadata
I20260807 20:17:57.853566 11829 ts_tablet_manager.cc:1939] T b4ef5bbf5530423a9035d4d353f705c1 P 95589b14f4d84d6d89f09925c5d9b714: Deleting consensus metadata
I20260807 20:17:57.853765 10918 catalog_manager.cc:4841] TS 9c9a58b62f3140cb9389f15cb9e82c2c (127.30.35.195:35777): tablet b4ef5bbf5530423a9035d4d353f705c1 (table test-table [id=f946735d9b8e4b568ce48439e8269742]) successfully deleted
I20260807 20:17:57.853993 10917 catalog_manager.cc:4841] TS 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249): tablet b4ef5bbf5530423a9035d4d353f705c1 (table test-table [id=f946735d9b8e4b568ce48439e8269742]) successfully deleted
I20260807 20:17:57.854230 11794 tablet_bootstrap.cc:492] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714: No bootstrap required, opened a new log
I20260807 20:17:57.854286 11794 ts_tablet_manager.cc:1397] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260807 20:17:57.854418 11794 raft_consensus.cc:348] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.854487 11794 raft_consensus.cc:374] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:57.854513 11794 raft_consensus.cc:729] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95589b14f4d84d6d89f09925c5d9b714, State: Initialized, Role: FOLLOWER
I20260807 20:17:57.854559 11794 consensus_queue.cc:260] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.854642 11794 ts_tablet_manager.cc:1428] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
W20260807 20:17:57.928125 11283 tablet.cc:2369] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:17:57.939414 11798 raft_consensus.cc:482] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:57.939515 11798 raft_consensus.cc:504] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.939687 11798 leader_election.cc:288] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249), 9c9a58b62f3140cb9389f15cb9e82c2c (127.30.35.195:35777)
I20260807 20:17:57.939901 11655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e718f741d0b45bcaae688bbb2f02319" candidate_uuid: "31ed92fd8fd846e38674824c1ac0021a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" is_pre_election: true
I20260807 20:17:57.939895 11202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e718f741d0b45bcaae688bbb2f02319" candidate_uuid: "31ed92fd8fd846e38674824c1ac0021a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95589b14f4d84d6d89f09925c5d9b714" is_pre_election: true
I20260807 20:17:57.940004 11655 raft_consensus.cc:2454] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ed92fd8fd846e38674824c1ac0021a in term 0.
I20260807 20:17:57.940014 11202 raft_consensus.cc:2454] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ed92fd8fd846e38674824c1ac0021a in term 0.
I20260807 20:17:57.940165 11322 leader_election.cc:302] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ed92fd8fd846e38674824c1ac0021a, 9c9a58b62f3140cb9389f15cb9e82c2c; no voters:
I20260807 20:17:57.940260 11798 raft_consensus.cc:2781] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:57.940303 11798 raft_consensus.cc:482] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:57.940322 11798 raft_consensus.cc:3037] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:57.941012 11798 raft_consensus.cc:504] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.941148 11798 leader_election.cc:288] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [CANDIDATE]: Term 1 election: Requested vote from peers 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249), 9c9a58b62f3140cb9389f15cb9e82c2c (127.30.35.195:35777)
I20260807 20:17:57.941315 11202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e718f741d0b45bcaae688bbb2f02319" candidate_uuid: "31ed92fd8fd846e38674824c1ac0021a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95589b14f4d84d6d89f09925c5d9b714"
I20260807 20:17:57.941342 11655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e718f741d0b45bcaae688bbb2f02319" candidate_uuid: "31ed92fd8fd846e38674824c1ac0021a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c"
I20260807 20:17:57.941417 11202 raft_consensus.cc:3037] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:57.941421 11655 raft_consensus.cc:3037] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:57.942106 11655 raft_consensus.cc:2454] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ed92fd8fd846e38674824c1ac0021a in term 1.
I20260807 20:17:57.942276 11322 leader_election.cc:302] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ed92fd8fd846e38674824c1ac0021a, 9c9a58b62f3140cb9389f15cb9e82c2c; no voters:
I20260807 20:17:57.942353 11798 raft_consensus.cc:2781] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:57.942369 11202 raft_consensus.cc:2454] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ed92fd8fd846e38674824c1ac0021a in term 1.
I20260807 20:17:57.942394 11798 raft_consensus.cc:686] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [term 1 LEADER]: Becoming Leader. State: Replica: 31ed92fd8fd846e38674824c1ac0021a, State: Running, Role: LEADER
I20260807 20:17:57.942451 11798 consensus_queue.cc:237] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:57.943005 10939 catalog_manager.cc:5495] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a reported cstate change: term changed from 0 to 1, leader changed from <none> to 31ed92fd8fd846e38674824c1ac0021a (127.30.35.194). New cstate: current_term: 1 leader_uuid: "31ed92fd8fd846e38674824c1ac0021a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } health_report { overall_health: UNKNOWN } } }
W20260807 20:17:57.986078 11737 tablet.cc:2369] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 20:17:57 dist-test-slave-t7g5 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133877, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.254@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
I20260807 20:17:57.997151 11843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.990335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:37621 (local address 127.0.0.1:56092)
0807 20:17:57.990560 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:57.990570 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:57.990653 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:57.990781 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:57.990782 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:57.991137 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:17:57.991210 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.991213 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.991932 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.991934 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.992459 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:57.992461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.992776 (+ 315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.992777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:57.992825 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.993326 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:17:57.993331 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:17:57.994722 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:17:57.996123 (+ 1401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:57.996132 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:57.996134 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:57.996331 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:57.996499 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:17:57.996500 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:17:57.996500 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:17:57.996557 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:17:57.996781 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:17:57.996790 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:17:57.996839 (+ 49us) client_negotiation.cc:769] Sending connection context
0807 20:17:57.996900 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 20:17:57.997025 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":5,"thread_start_us":117,"threads_started":1}
I20260807 20:17:57.997153 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:57.990440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56092 (local address 127.30.35.254:37621)
0807 20:17:57.990502 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:57.990504 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:57.990642 (+ 138us) server_negotiation.cc:407] Connection header received
0807 20:17:57.990711 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:57.990712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:57.990723 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:57.990781 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:57.991293 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.991858 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.992536 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:57.992720 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:57.992780 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:57.994810 (+ 2030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:57.994811 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:57.994811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:57.994818 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:57.996049 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.996395 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.996396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.996396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.996449 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:57.996605 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:57.996606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:57.996606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:57.996729 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:57.996792 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:57.996927 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 20:17:57.997082 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":83,"server-negotiator.queue_time_us":35}
I20260807 20:17:57.999123 10939 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:56092:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 20:17:57.999323 10939 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:58.000572 11182 tablet_service.cc:1467] Processing CreateTablet for tablet ff209c5d29944d1f94ee124c87f23c9c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1fe53d89fc684c2ebd787398ae3572c7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 20:17:58.000624 11396 tablet_service.cc:1467] Processing CreateTablet for tablet ff209c5d29944d1f94ee124c87f23c9c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1fe53d89fc684c2ebd787398ae3572c7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 20:17:58.000746 11182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff209c5d29944d1f94ee124c87f23c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:58.000720 11619 tablet_service.cc:1467] Processing CreateTablet for tablet ff209c5d29944d1f94ee124c87f23c9c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1fe53d89fc684c2ebd787398ae3572c7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 20:17:58.000788 11396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff209c5d29944d1f94ee124c87f23c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:58.000859 11619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff209c5d29944d1f94ee124c87f23c9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:58.002029 11787 tablet_bootstrap.cc:492] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a: Bootstrap starting.
I20260807 20:17:58.002288 11783 tablet_bootstrap.cc:492] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c: Bootstrap starting.
I20260807 20:17:58.002346 11794 tablet_bootstrap.cc:492] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714: Bootstrap starting.
I20260807 20:17:58.002368 11787 tablet_bootstrap.cc:654] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:58.002689 11783 tablet_bootstrap.cc:654] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:58.002745 11794 tablet_bootstrap.cc:654] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:58.003021 11787 tablet_bootstrap.cc:492] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a: No bootstrap required, opened a new log
I20260807 20:17:58.003078 11787 ts_tablet_manager.cc:1397] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 20:17:58.003204 11787 raft_consensus.cc:348] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.003281 11787 raft_consensus.cc:374] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:58.003301 11787 raft_consensus.cc:729] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ed92fd8fd846e38674824c1ac0021a, State: Initialized, Role: FOLLOWER
I20260807 20:17:58.003298 11783 tablet_bootstrap.cc:492] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c: No bootstrap required, opened a new log
I20260807 20:17:58.003335 11783 ts_tablet_manager.cc:1397] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 20:17:58.003340 11787 consensus_queue.cc:260] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.003436 11787 ts_tablet_manager.cc:1428] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260807 20:17:58.003487 11802 tablet_replica.cc:439] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } } }
I20260807 20:17:58.003587 11802 tablet_replica.cc:442] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:58.003556 11783 raft_consensus.cc:348] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.003628 11783 raft_consensus.cc:374] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:58.003649 11783 raft_consensus.cc:729] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c9a58b62f3140cb9389f15cb9e82c2c, State: Initialized, Role: FOLLOWER
I20260807 20:17:58.003696 11783 consensus_queue.cc:260] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.003786 11783 ts_tablet_manager.cc:1428] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:58.003960 11797 tablet_replica.cc:439] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } } }
I20260807 20:17:58.004070 11797 tablet_replica.cc:442] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:58.004185 11794 tablet_bootstrap.cc:492] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714: No bootstrap required, opened a new log
I20260807 20:17:58.004236 11794 ts_tablet_manager.cc:1397] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:58.004379 11794 raft_consensus.cc:348] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.004436 11794 raft_consensus.cc:374] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:58.004452 11794 raft_consensus.cc:729] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95589b14f4d84d6d89f09925c5d9b714, State: Initialized, Role: FOLLOWER
I20260807 20:17:58.004494 11794 consensus_queue.cc:260] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.004595 11794 ts_tablet_manager.cc:1428] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:58.004642 11800 tablet_replica.cc:439] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } } }
I20260807 20:17:58.004720 11800 tablet_replica.cc:442] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:58.168134 11797 raft_consensus.cc:482] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:58.168260 11797 raft_consensus.cc:504] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.168606 11797 leader_election.cc:288] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249), 31ed92fd8fd846e38674824c1ac0021a (127.30.35.194:33531)
I20260807 20:17:58.171350 11558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.168803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:33531 (local address 127.30.35.195:45413)
0807 20:17:58.168873 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:58.168885 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:58.168934 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:58.169076 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:58.169077 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:58.169079 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:58.169142 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.169144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.169763 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.169764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.170585 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.170587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.171120 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.171121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.171188 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.171190 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 20:17:58.171236 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 20:17:58.171273 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 20:17:58.171350 11776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.168883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:45413 (local address 127.30.35.194:33531)
0807 20:17:58.168970 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:58.168972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:58.168979 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:17:58.169005 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:58.169006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:58.169018 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:58.169063 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:58.169203 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.169690 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.170668 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.171052 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.171115 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.171125 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:58.171247 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 20:17:58.171286 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 20:17:58.171660 11421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff209c5d29944d1f94ee124c87f23c9c" candidate_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ed92fd8fd846e38674824c1ac0021a" is_pre_election: true
I20260807 20:17:58.171792 11421 raft_consensus.cc:2454] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c9a58b62f3140cb9389f15cb9e82c2c in term 0.
I20260807 20:17:58.171838 11851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.168802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:33249 (local address 127.30.35.195:48279)
0807 20:17:58.169029 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:58.169039 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:58.169099 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:58.169228 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:58.169229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:58.169230 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:58.169301 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.169302 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.170011 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.170012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.171046 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.171049 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.171597 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.171598 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.171669 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.171672 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:58.171716 (+ 44us) client_negotiation.cc:240] Negotiation successful
0807 20:17:58.171754 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":24,"thread_start_us":152,"threads_started":1}
I20260807 20:17:58.171831 11782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.168895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:48279 (local address 127.30.35.193:33249)
0807 20:17:58.168962 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:58.168964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:58.169107 (+ 143us) server_negotiation.cc:407] Connection header received
0807 20:17:58.169159 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:58.169160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:58.169169 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:58.169218 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:58.169361 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.169926 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.171134 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.171530 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.171596 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.171604 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:58.171734 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 20:17:58.171769 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 20:17:58.171974 11800 raft_consensus.cc:482] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:58.172004 11536 leader_election.cc:302] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ed92fd8fd846e38674824c1ac0021a, 9c9a58b62f3140cb9389f15cb9e82c2c; no voters:
I20260807 20:17:58.172020 11800 raft_consensus.cc:504] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.172168 11797 raft_consensus.cc:2781] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:58.172212 11797 raft_consensus.cc:482] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:58.172230 11797 raft_consensus.cc:3037] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:58.172339 11800 leader_election.cc:288] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31ed92fd8fd846e38674824c1ac0021a (127.30.35.194:33531), 9c9a58b62f3140cb9389f15cb9e82c2c (127.30.35.195:35777)
I20260807 20:17:58.172428 11202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff209c5d29944d1f94ee124c87f23c9c" candidate_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95589b14f4d84d6d89f09925c5d9b714" is_pre_election: true
I20260807 20:17:58.172489 11202 raft_consensus.cc:2454] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c9a58b62f3140cb9389f15cb9e82c2c in term 0.
I20260807 20:17:58.173092 11797 raft_consensus.cc:504] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.173197 11797 leader_election.cc:288] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [CANDIDATE]: Term 1 election: Requested vote from peers 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249), 31ed92fd8fd846e38674824c1ac0021a (127.30.35.194:33531)
I20260807 20:17:58.173339 11202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff209c5d29944d1f94ee124c87f23c9c" candidate_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95589b14f4d84d6d89f09925c5d9b714"
I20260807 20:17:58.173415 11202 raft_consensus.cc:3037] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:58.173434 11421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff209c5d29944d1f94ee124c87f23c9c" candidate_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ed92fd8fd846e38674824c1ac0021a"
I20260807 20:17:58.173511 11421 raft_consensus.cc:3037] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:58.174157 11202 raft_consensus.cc:2454] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c9a58b62f3140cb9389f15cb9e82c2c in term 1.
I20260807 20:17:58.174364 11540 leader_election.cc:302] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95589b14f4d84d6d89f09925c5d9b714, 9c9a58b62f3140cb9389f15cb9e82c2c; no voters:
I20260807 20:17:58.174376 11421 raft_consensus.cc:2454] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c9a58b62f3140cb9389f15cb9e82c2c in term 1.
I20260807 20:17:58.174499 11797 raft_consensus.cc:2781] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:58.174636 11797 raft_consensus.cc:686] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 LEADER]: Becoming Leader. State: Replica: 9c9a58b62f3140cb9389f15cb9e82c2c, State: Running, Role: LEADER
I20260807 20:17:58.174702 11797 consensus_queue.cc:237] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.175388 11855 tablet_replica.cc:439] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c: TxnStatusTablet state changed. Reason: New leader 9c9a58b62f3140cb9389f15cb9e82c2c. Latest consensus state: current_term: 1 leader_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } } }
I20260807 20:17:58.175395 10938 catalog_manager.cc:5495] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c9a58b62f3140cb9389f15cb9e82c2c (127.30.35.195). New cstate: current_term: 1 leader_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } health_report { overall_health: HEALTHY } } }
I20260807 20:17:58.175532 11855 tablet_replica.cc:442] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c: This TxnStatusTablet replica's current role is: LEADER
I20260807 20:17:58.175618 11776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.172655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:38069 (local address 127.30.35.194:33531)
0807 20:17:58.172693 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:58.172695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:58.172703 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:17:58.172756 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:58.172757 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:58.172765 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:58.172810 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:58.172896 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.173400 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.174749 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.175264 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.175327 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.175334 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:58.175521 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 20:17:58.175559 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 20:17:58.175828 11854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.172454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:33531 (local address 127.30.35.193:38069)
0807 20:17:58.172643 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:58.172654 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:58.172707 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:58.172811 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:58.172812 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:58.172814 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:58.172852 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.172853 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.173498 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.173499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.174641 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.174644 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.175366 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.175367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.175430 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.175434 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:58.175711 (+ 277us) client_negotiation.cc:240] Negotiation successful
0807 20:17:58.175752 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":59,"threads_started":1}
I20260807 20:17:58.176268 11421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff209c5d29944d1f94ee124c87f23c9c" candidate_uuid: "95589b14f4d84d6d89f09925c5d9b714" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ed92fd8fd846e38674824c1ac0021a" is_pre_election: true
I20260807 20:17:58.176311 11777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.173291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:52853 (local address 127.30.35.195:35777)
0807 20:17:58.173338 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:58.173340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:58.173347 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:17:58.173366 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:58.173366 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:58.173374 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:58.173415 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:17:58.173610 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.174220 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.175478 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.175985 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.176026 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.176033 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:58.176228 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 20:17:58.176262 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 20:17:58.176365 11852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.172472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:35777 (local address 127.30.35.193:52853)
0807 20:17:58.172744 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:58.172753 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:58.172798 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:58.173458 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:58.173460 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:58.173462 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:17:58.173531 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.173533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.174318 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.174318 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.175379 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.175381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.176095 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.176095 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.176167 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.176170 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:17:58.176214 (+ 44us) client_negotiation.cc:240] Negotiation successful
0807 20:17:58.176247 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":55,"threads_started":1}
I20260807 20:17:58.176374 11421 raft_consensus.cc:2379] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95589b14f4d84d6d89f09925c5d9b714 in current term 1: Already voted for candidate 9c9a58b62f3140cb9389f15cb9e82c2c in this term.
I20260807 20:17:58.176488 11859 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 20:17:58.176560 11655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff209c5d29944d1f94ee124c87f23c9c" candidate_uuid: "95589b14f4d84d6d89f09925c5d9b714" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" is_pre_election: true
I20260807 20:17:58.176620 11859 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 20:17:58.176734 11104 leader_election.cc:302] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95589b14f4d84d6d89f09925c5d9b714; no voters: 31ed92fd8fd846e38674824c1ac0021a, 9c9a58b62f3140cb9389f15cb9e82c2c
I20260807 20:17:58.176887 11800 raft_consensus.cc:2726] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 20:17:58.184983 11843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.181743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:35777 (local address 127.0.0.1:51480)
0807 20:17:58.181826 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:58.181836 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:58.181886 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:58.182064 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:58.182064 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:58.182066 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 20:17:58.182131 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.182133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.182964 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.182965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.183876 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.183880 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.184375 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.184376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.184491 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.184512 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 20:17:58.184837 (+ 325us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 20:17:58.184846 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 20:17:58.184885 (+ 39us) client_negotiation.cc:240] Negotiation successful
0807 20:17:58.184929 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 20:17:58.184983 11777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.181785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51480 (local address 127.30.35.195:35777)
0807 20:17:58.181818 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:58.181819 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:58.181868 (+ 49us) server_negotiation.cc:407] Connection header received
0807 20:17:58.181968 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:58.181969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:58.181985 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:58.182054 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:58.182259 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.182881 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.183994 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.184270 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.184333 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.184638 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:58.184776 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:58.184850 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:58.184890 (+ 40us) server_negotiation.cc:299] Negotiation successful
0807 20:17:58.184916 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260807 20:17:58.186065 11202 raft_consensus.cc:1261] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Refusing update from remote peer 9c9a58b62f3140cb9389f15cb9e82c2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:58.186192 11421 raft_consensus.cc:1261] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Refusing update from remote peer 9c9a58b62f3140cb9389f15cb9e82c2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:58.186471 11855 consensus_queue.cc:1035] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:58.186626 11797 consensus_queue.cc:1035] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:58.187127 11802 tablet_replica.cc:439] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a: TxnStatusTablet state changed. Reason: New leader 9c9a58b62f3140cb9389f15cb9e82c2c. Latest consensus state: current_term: 1 leader_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } } }
I20260807 20:17:58.187215 11802 tablet_replica.cc:442] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:58.187297 11800 tablet_replica.cc:439] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714: TxnStatusTablet state changed. Reason: New leader 9c9a58b62f3140cb9389f15cb9e82c2c. Latest consensus state: current_term: 1 leader_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } } }
I20260807 20:17:58.187371 11800 tablet_replica.cc:442] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:58.187716 11816 mvcc.cc:205] Tried to move back new op lower bound from 7316004365048029184 to 7316004365004054528. Current Snapshot: MvccSnapshot[applied={T|T < 7316004365048029184}]
I20260807 20:17:58.187896 11855 tablet_replica.cc:439] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } } }
I20260807 20:17:58.187976 11855 tablet_replica.cc:442] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c: This TxnStatusTablet replica's current role is: LEADER
I20260807 20:17:58.188283 11814 mvcc.cc:205] Tried to move back new op lower bound from 7316004365048029184 to 7316004365004054528. Current Snapshot: MvccSnapshot[applied={T|T < 7316004365048029184 or (T in {7316004365048029184})}]
I20260807 20:17:58.189994 11800 tablet_replica.cc:439] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } } }
I20260807 20:17:58.190083 11800 tablet_replica.cc:442] T ff209c5d29944d1f94ee124c87f23c9c P 95589b14f4d84d6d89f09925c5d9b714: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:58.193856 11855 tablet_replica.cc:439] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } } }
I20260807 20:17:58.195990 11802 tablet_replica.cc:439] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } } }
I20260807 20:17:58.196081 11802 tablet_replica.cc:442] T ff209c5d29944d1f94ee124c87f23c9c P 31ed92fd8fd846e38674824c1ac0021a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 20:17:58.194007 11855 tablet_replica.cc:442] T ff209c5d29944d1f94ee124c87f23c9c P 9c9a58b62f3140cb9389f15cb9e82c2c: This TxnStatusTablet replica's current role is: LEADER
I20260807 20:17:58.199829 11777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.196150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:48473 (local address 127.30.35.195:35777)
0807 20:17:58.196185 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:58.196187 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:58.196698 (+ 511us) server_negotiation.cc:407] Connection header received
0807 20:17:58.196794 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:58.196795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:58.196805 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:58.196832 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:58.197271 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.198161 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.199287 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.199463 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.199504 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.199663 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:58.199686 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:58.199715 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:58.199767 (+ 52us) server_negotiation.cc:299] Negotiation successful
0807 20:17:58.199781 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 20:17:58.199898 11871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.196009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:35777 (local address 127.30.35.194:48473)
0807 20:17:58.196632 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:58.196643 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:58.196726 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:58.196887 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:58.196888 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:58.197130 (+ 242us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 20:17:58.197185 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.197188 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.198238 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.198239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.199215 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.199219 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.199521 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.199522 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.199580 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.199597 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 20:17:58.199719 (+ 122us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 20:17:58.199720 (+ 1us) client_negotiation.cc:769] Sending connection context
0807 20:17:58.199764 (+ 44us) client_negotiation.cc:240] Negotiation successful
0807 20:17:58.199813 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":46,"threads_started":1}
I20260807 20:17:58.201781 11202 raft_consensus.cc:1261] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Refusing update from remote peer 31ed92fd8fd846e38674824c1ac0021a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:58.201803 11655 raft_consensus.cc:1261] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Refusing update from remote peer 31ed92fd8fd846e38674824c1ac0021a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:58.202003 11802 consensus_queue.cc:1035] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [LEADER]: Connected to new peer: Peer: permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:58.202118 11798 consensus_queue.cc:1035] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:58.210193 11776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.207385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:57989 (local address 127.30.35.194:33531)
0807 20:17:58.207422 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:58.207424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:58.207457 (+ 33us) server_negotiation.cc:407] Connection header received
0807 20:17:58.207519 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:58.207520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:58.207530 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:58.207580 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:58.207715 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.208440 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.209531 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.209764 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.209819 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.209989 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:58.210022 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:58.210060 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:58.210129 (+ 69us) server_negotiation.cc:299] Negotiation successful
0807 20:17:58.210146 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 20:17:58.210242 11745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.207339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:33531 (local address 127.30.35.195:57989)
0807 20:17:58.207398 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:58.207419 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:58.207470 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:58.207586 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:58.207587 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:58.207588 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 20:17:58.207647 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.207649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.208531 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.208532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.209446 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.209449 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.209823 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.209824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.209888 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.209904 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 20:17:58.210070 (+ 166us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 20:17:58.210072 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 20:17:58.210126 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 20:17:58.210169 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260807 20:17:58.218047 10938 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:58.218129 10938 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56076:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:58.218680 10938 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530: Sending DeleteTablet for 3 replicas of tablet 6e718f741d0b45bcaae688bbb2f02319
I20260807 20:17:58.218927 11396 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e718f741d0b45bcaae688bbb2f02319 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:58 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:40156
I20260807 20:17:58.218993 11619 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e718f741d0b45bcaae688bbb2f02319 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:58 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:51464
I20260807 20:17:58.219017 11828 tablet_replica.cc:330] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a: stopping tablet replica
I20260807 20:17:58.219007 11182 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e718f741d0b45bcaae688bbb2f02319 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:58 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:56174
I20260807 20:17:58.219063 11828 raft_consensus.cc:2229] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:17:58.219110 11828 raft_consensus.cc:2258] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:58.219107 11826 tablet_replica.cc:330] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c: stopping tablet replica
I20260807 20:17:58.219113 11829 tablet_replica.cc:330] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714: stopping tablet replica
I20260807 20:17:58.219161 11826 raft_consensus.cc:2229] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:58.219164 11829 raft_consensus.cc:2229] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:58.219192 11826 raft_consensus.cc:2258] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:58.219194 11829 raft_consensus.cc:2258] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:58.219480 11826 ts_tablet_manager.cc:1905] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:58.219481 11829 ts_tablet_manager.cc:1905] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:58.219533 11828 ts_tablet_manager.cc:1905] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:58.221203 11829 ts_tablet_manager.cc:1918] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 20:17:58.221202 11828 ts_tablet_manager.cc:1918] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 20:17:58.221261 11829 log.cc:1196] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/wal/wals/6e718f741d0b45bcaae688bbb2f02319
I20260807 20:17:58.221263 11828 log.cc:1196] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/6e718f741d0b45bcaae688bbb2f02319
I20260807 20:17:58.221473 11828 ts_tablet_manager.cc:1939] T 6e718f741d0b45bcaae688bbb2f02319 P 31ed92fd8fd846e38674824c1ac0021a: Deleting consensus metadata
I20260807 20:17:58.221487 11829 ts_tablet_manager.cc:1939] T 6e718f741d0b45bcaae688bbb2f02319 P 95589b14f4d84d6d89f09925c5d9b714: Deleting consensus metadata
I20260807 20:17:58.221843 10917 catalog_manager.cc:4841] TS 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249): tablet 6e718f741d0b45bcaae688bbb2f02319 (table test-table [id=6a6b08d1f4d94f22ba5e2bee63c4c489]) successfully deleted
I20260807 20:17:58.224529 10914 catalog_manager.cc:4841] TS 31ed92fd8fd846e38674824c1ac0021a (127.30.35.194:33531): tablet 6e718f741d0b45bcaae688bbb2f02319 (table test-table [id=6a6b08d1f4d94f22ba5e2bee63c4c489]) successfully deleted
I20260807 20:17:58.224591 11826 ts_tablet_manager.cc:1918] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 20:17:58.224643 11826 log.cc:1196] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/6e718f741d0b45bcaae688bbb2f02319
I20260807 20:17:58.224818 11826 ts_tablet_manager.cc:1939] T 6e718f741d0b45bcaae688bbb2f02319 P 9c9a58b62f3140cb9389f15cb9e82c2c: Deleting consensus metadata
I20260807 20:17:58.225090 10918 catalog_manager.cc:4841] TS 9c9a58b62f3140cb9389f15cb9e82c2c (127.30.35.195:35777): tablet 6e718f741d0b45bcaae688bbb2f02319 (table test-table [id=6a6b08d1f4d94f22ba5e2bee63c4c489]) successfully deleted
Aug 07 20:17:58 dist-test-slave-t7g5 krb5kdc[10865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 20:17:58 dist-test-slave-t7g5 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:17:58 dist-test-slave-t7g5 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 20:17:58.246749 11030 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:17:58.240750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56108 (local address 127.30.35.254:37621)
0807 20:17:58.240807 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:58.240810 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:58.240937 (+ 127us) server_negotiation.cc:407] Connection header received
0807 20:17:58.241001 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:58.241002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:58.241012 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:58.241084 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:58.241843 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.242448 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.243490 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.243661 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.243705 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.246692 (+ 2987us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56108: BlockingRecv error: recv got EOF from 127.0.0.1:56108 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 07 20:17:58 dist-test-slave-t7g5 krb5kdc[10865](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM
I20260807 20:17:58.254390 11030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.247493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56114 (local address 127.30.35.254:37621)
0807 20:17:58.247527 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:58.247529 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:58.247611 (+ 82us) server_negotiation.cc:407] Connection header received
0807 20:17:58.247650 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:58.247651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:58.247661 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:58.247722 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:17:58.248110 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.248791 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.249419 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.249732 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.249802 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.252088 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:17:58.252089 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:17:58.252090 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:17:58.252096 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:17:58.253377 (+ 1281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:58.253765 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:58.253766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:58.253766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:58.253816 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:17:58.254000 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:17:58.254000 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:17:58.254000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:17:58.254091 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:17:58.254159 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:58.254277 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 20:17:58.254329 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 20:17:58.255895 10938 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56114:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:17:58.256045 10938 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:58.257472 11619 tablet_service.cc:1467] Processing CreateTablet for tablet 6eb7c2e6602447eeabad98e50f9c15d3 (DEFAULT_TABLE table=test-table [id=61b675a3220c4f74944a10c8fa98b4df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:58.257493 11396 tablet_service.cc:1467] Processing CreateTablet for tablet 6eb7c2e6602447eeabad98e50f9c15d3 (DEFAULT_TABLE table=test-table [id=61b675a3220c4f74944a10c8fa98b4df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:58.257620 11396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eb7c2e6602447eeabad98e50f9c15d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:58.257617 11619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eb7c2e6602447eeabad98e50f9c15d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:58.258589 11787 tablet_bootstrap.cc:492] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a: Bootstrap starting.
I20260807 20:17:58.258970 11787 tablet_bootstrap.cc:654] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:58.259071 11182 tablet_service.cc:1467] Processing CreateTablet for tablet 6eb7c2e6602447eeabad98e50f9c15d3 (DEFAULT_TABLE table=test-table [id=61b675a3220c4f74944a10c8fa98b4df]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:58.259199 11182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eb7c2e6602447eeabad98e50f9c15d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:58.259192 11783 tablet_bootstrap.cc:492] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c: Bootstrap starting.
I20260807 20:17:58.259485 11783 tablet_bootstrap.cc:654] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:58.259975 11787 tablet_bootstrap.cc:492] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a: No bootstrap required, opened a new log
I20260807 20:17:58.260023 11787 ts_tablet_manager.cc:1397] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 20:17:58.260164 11787 raft_consensus.cc:348] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.260223 11787 raft_consensus.cc:374] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:58.260241 11787 raft_consensus.cc:729] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ed92fd8fd846e38674824c1ac0021a, State: Initialized, Role: FOLLOWER
I20260807 20:17:58.260282 11787 consensus_queue.cc:260] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.260365 11787 ts_tablet_manager.cc:1428] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:58.260547 11794 tablet_bootstrap.cc:492] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714: Bootstrap starting.
I20260807 20:17:58.260682 11783 tablet_bootstrap.cc:492] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c: No bootstrap required, opened a new log
I20260807 20:17:58.260727 11783 ts_tablet_manager.cc:1397] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 20:17:58.260890 11783 raft_consensus.cc:348] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.260967 11783 raft_consensus.cc:374] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:58.260987 11783 raft_consensus.cc:729] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c9a58b62f3140cb9389f15cb9e82c2c, State: Initialized, Role: FOLLOWER
I20260807 20:17:58.260982 11794 tablet_bootstrap.cc:654] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:58.261018 11783 consensus_queue.cc:260] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.261098 11783 ts_tablet_manager.cc:1428] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260807 20:17:58.261853 11794 tablet_bootstrap.cc:492] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714: No bootstrap required, opened a new log
I20260807 20:17:58.261899 11794 ts_tablet_manager.cc:1397] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:58.262037 11794 raft_consensus.cc:348] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.262102 11794 raft_consensus.cc:374] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:58.262118 11794 raft_consensus.cc:729] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95589b14f4d84d6d89f09925c5d9b714, State: Initialized, Role: FOLLOWER
I20260807 20:17:58.262161 11794 consensus_queue.cc:260] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.262236 11794 ts_tablet_manager.cc:1428] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260807 20:17:58.341940 11797 raft_consensus.cc:482] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:58.342060 11797 raft_consensus.cc:504] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.342224 11797 leader_election.cc:288] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249), 31ed92fd8fd846e38674824c1ac0021a (127.30.35.194:33531)
I20260807 20:17:58.342419 11421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eb7c2e6602447eeabad98e50f9c15d3" candidate_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ed92fd8fd846e38674824c1ac0021a" is_pre_election: true
I20260807 20:17:58.342442 11202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eb7c2e6602447eeabad98e50f9c15d3" candidate_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95589b14f4d84d6d89f09925c5d9b714" is_pre_election: true
I20260807 20:17:58.342536 11421 raft_consensus.cc:2454] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c9a58b62f3140cb9389f15cb9e82c2c in term 0.
I20260807 20:17:58.342557 11202 raft_consensus.cc:2454] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c9a58b62f3140cb9389f15cb9e82c2c in term 0.
I20260807 20:17:58.342695 11536 leader_election.cc:302] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ed92fd8fd846e38674824c1ac0021a, 9c9a58b62f3140cb9389f15cb9e82c2c; no voters:
I20260807 20:17:58.342805 11797 raft_consensus.cc:2781] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:58.342854 11797 raft_consensus.cc:482] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:58.342867 11797 raft_consensus.cc:3037] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:58.343495 11797 raft_consensus.cc:504] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.343609 11797 leader_election.cc:288] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [CANDIDATE]: Term 1 election: Requested vote from peers 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249), 31ed92fd8fd846e38674824c1ac0021a (127.30.35.194:33531)
I20260807 20:17:58.343771 11421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eb7c2e6602447eeabad98e50f9c15d3" candidate_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ed92fd8fd846e38674824c1ac0021a"
I20260807 20:17:58.343784 11202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eb7c2e6602447eeabad98e50f9c15d3" candidate_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95589b14f4d84d6d89f09925c5d9b714"
I20260807 20:17:58.343855 11202 raft_consensus.cc:3037] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:58.343851 11421 raft_consensus.cc:3037] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:58.344451 11202 raft_consensus.cc:2454] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c9a58b62f3140cb9389f15cb9e82c2c in term 1.
I20260807 20:17:58.344465 11421 raft_consensus.cc:2454] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c9a58b62f3140cb9389f15cb9e82c2c in term 1.
I20260807 20:17:58.344637 11536 leader_election.cc:302] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ed92fd8fd846e38674824c1ac0021a, 9c9a58b62f3140cb9389f15cb9e82c2c; no voters:
I20260807 20:17:58.344731 11797 raft_consensus.cc:2781] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:58.344798 11797 raft_consensus.cc:686] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 LEADER]: Becoming Leader. State: Replica: 9c9a58b62f3140cb9389f15cb9e82c2c, State: Running, Role: LEADER
I20260807 20:17:58.344853 11797 consensus_queue.cc:237] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.345427 10938 catalog_manager.cc:5495] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c9a58b62f3140cb9389f15cb9e82c2c (127.30.35.195). New cstate: current_term: 1 leader_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } health_report { overall_health: HEALTHY } } }
I20260807 20:17:58.352571 11777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.350484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51482 (local address 127.30.35.195:35777)
0807 20:17:58.350532 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:58.350534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:58.350578 (+ 44us) server_negotiation.cc:407] Connection header received
0807 20:17:58.350640 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:58.350640 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:58.350649 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:58.350684 (+ 35us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:58.350815 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.351285 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.352003 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.352184 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.352239 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.352361 (+ 122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:58.352391 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:58.352432 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:58.352483 (+ 51us) server_negotiation.cc:299] Negotiation successful
0807 20:17:58.352504 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:17:58.353384 11421 raft_consensus.cc:1261] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Refusing update from remote peer 9c9a58b62f3140cb9389f15cb9e82c2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:58.353451 11202 raft_consensus.cc:1261] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Refusing update from remote peer 9c9a58b62f3140cb9389f15cb9e82c2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:58.353619 11797 consensus_queue.cc:1035] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:58.353775 11872 consensus_queue.cc:1035] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:58.356730 10938 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:58.356828 10938 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:58.357417 10938 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530: Sending DeleteTablet for 3 replicas of tablet 6eb7c2e6602447eeabad98e50f9c15d3
I20260807 20:17:58.357635 11182 tablet_service.cc:1514] Processing DeleteTablet for tablet 6eb7c2e6602447eeabad98e50f9c15d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:58 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:56174
I20260807 20:17:58.357733 11396 tablet_service.cc:1514] Processing DeleteTablet for tablet 6eb7c2e6602447eeabad98e50f9c15d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:58 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:40156
I20260807 20:17:58.357754 11619 tablet_service.cc:1514] Processing DeleteTablet for tablet 6eb7c2e6602447eeabad98e50f9c15d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:58 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:51464
I20260807 20:17:58.357832 11829 tablet_replica.cc:330] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714: stopping tablet replica
I20260807 20:17:58.357892 11829 raft_consensus.cc:2229] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:58.357970 11829 raft_consensus.cc:2258] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:58.358049 11828 tablet_replica.cc:330] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a: stopping tablet replica
I20260807 20:17:58.358119 11828 raft_consensus.cc:2229] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:58.358170 11828 raft_consensus.cc:2258] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:58.358248 11826 tablet_replica.cc:330] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c: stopping tablet replica
I20260807 20:17:58.358305 11826 raft_consensus.cc:2229] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:17:58.358397 11826 raft_consensus.cc:2258] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:58.358441 11828 ts_tablet_manager.cc:1905] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:58.358850 11829 ts_tablet_manager.cc:1905] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:58.359846 11828 ts_tablet_manager.cc:1918] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:58.359896 11828 log.cc:1196] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/6eb7c2e6602447eeabad98e50f9c15d3
I20260807 20:17:58.360090 11828 ts_tablet_manager.cc:1939] T 6eb7c2e6602447eeabad98e50f9c15d3 P 31ed92fd8fd846e38674824c1ac0021a: Deleting consensus metadata
I20260807 20:17:58.360239 11829 ts_tablet_manager.cc:1918] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:58.360304 11829 log.cc:1196] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-0/wal/wals/6eb7c2e6602447eeabad98e50f9c15d3
I20260807 20:17:58.360491 11829 ts_tablet_manager.cc:1939] T 6eb7c2e6602447eeabad98e50f9c15d3 P 95589b14f4d84d6d89f09925c5d9b714: Deleting consensus metadata
I20260807 20:17:58.360707 11826 ts_tablet_manager.cc:1905] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:58.360855 10917 catalog_manager.cc:4841] TS 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249): tablet 6eb7c2e6602447eeabad98e50f9c15d3 (table test-table [id=61b675a3220c4f74944a10c8fa98b4df]) successfully deleted
I20260807 20:17:58.362098 11826 ts_tablet_manager.cc:1918] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:17:58.362160 11826 log.cc:1196] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/6eb7c2e6602447eeabad98e50f9c15d3
I20260807 20:17:58.362354 11826 ts_tablet_manager.cc:1939] T 6eb7c2e6602447eeabad98e50f9c15d3 P 9c9a58b62f3140cb9389f15cb9e82c2c: Deleting consensus metadata
I20260807 20:17:58.362600 10914 catalog_manager.cc:4841] TS 31ed92fd8fd846e38674824c1ac0021a (127.30.35.194:33531): tablet 6eb7c2e6602447eeabad98e50f9c15d3 (table test-table [id=61b675a3220c4f74944a10c8fa98b4df]) successfully deleted
I20260807 20:17:58.362640 10918 catalog_manager.cc:4841] TS 9c9a58b62f3140cb9389f15cb9e82c2c (127.30.35.195:35777): tablet 6eb7c2e6602447eeabad98e50f9c15d3 (table test-table [id=61b675a3220c4f74944a10c8fa98b4df]) successfully deleted
I20260807 20:17:58.362740 10938 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56114:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:17:58.362879 10938 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:17:58.364012 11396 tablet_service.cc:1467] Processing CreateTablet for tablet bfb711198ba647718e72e33c323a03a8 (DEFAULT_TABLE table=test-table [id=c5732e36dda14d24b464449f0feb6dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:58.364012 11182 tablet_service.cc:1467] Processing CreateTablet for tablet bfb711198ba647718e72e33c323a03a8 (DEFAULT_TABLE table=test-table [id=c5732e36dda14d24b464449f0feb6dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:58.364116 11182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfb711198ba647718e72e33c323a03a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:58.364117 11396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfb711198ba647718e72e33c323a03a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:58.365200 11787 tablet_bootstrap.cc:492] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a: Bootstrap starting.
I20260807 20:17:58.365445 11619 tablet_service.cc:1467] Processing CreateTablet for tablet bfb711198ba647718e72e33c323a03a8 (DEFAULT_TABLE table=test-table [id=c5732e36dda14d24b464449f0feb6dc0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:17:58.365516 11787 tablet_bootstrap.cc:654] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:58.365547 11619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfb711198ba647718e72e33c323a03a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:17:58.365728 11794 tablet_bootstrap.cc:492] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714: Bootstrap starting.
I20260807 20:17:58.366119 11794 tablet_bootstrap.cc:654] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:58.366710 11794 tablet_bootstrap.cc:492] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714: No bootstrap required, opened a new log
I20260807 20:17:58.366755 11794 ts_tablet_manager.cc:1397] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 20:17:58.366885 11794 raft_consensus.cc:348] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.366956 11794 raft_consensus.cc:374] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:58.366971 11794 raft_consensus.cc:729] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95589b14f4d84d6d89f09925c5d9b714, State: Initialized, Role: FOLLOWER
I20260807 20:17:58.367005 11794 consensus_queue.cc:260] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.367034 11787 tablet_bootstrap.cc:492] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a: No bootstrap required, opened a new log
I20260807 20:17:58.367074 11787 ts_tablet_manager.cc:1397] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:17:58.367089 11794 ts_tablet_manager.cc:1428] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:58.367166 11787 raft_consensus.cc:348] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.367193 11783 tablet_bootstrap.cc:492] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c: Bootstrap starting.
I20260807 20:17:58.367221 11787 raft_consensus.cc:374] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:58.367239 11787 raft_consensus.cc:729] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ed92fd8fd846e38674824c1ac0021a, State: Initialized, Role: FOLLOWER
I20260807 20:17:58.367287 11787 consensus_queue.cc:260] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.367365 11787 ts_tablet_manager.cc:1428] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:58.367523 11783 tablet_bootstrap.cc:654] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c: Neither blocks nor log segments found. Creating new log.
I20260807 20:17:58.368382 11783 tablet_bootstrap.cc:492] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c: No bootstrap required, opened a new log
I20260807 20:17:58.368435 11783 ts_tablet_manager.cc:1397] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260807 20:17:58.368538 11783 raft_consensus.cc:348] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.368595 11783 raft_consensus.cc:374] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:17:58.368613 11783 raft_consensus.cc:729] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c9a58b62f3140cb9389f15cb9e82c2c, State: Initialized, Role: FOLLOWER
I20260807 20:17:58.368659 11783 consensus_queue.cc:260] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.368747 11783 ts_tablet_manager.cc:1428] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:17:58.611207 11855 raft_consensus.cc:482] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:17:58.611305 11855 raft_consensus.cc:504] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.611482 11855 leader_election.cc:288] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249), 31ed92fd8fd846e38674824c1ac0021a (127.30.35.194:33531)
I20260807 20:17:58.611702 11421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfb711198ba647718e72e33c323a03a8" candidate_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ed92fd8fd846e38674824c1ac0021a" is_pre_election: true
I20260807 20:17:58.611691 11202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfb711198ba647718e72e33c323a03a8" candidate_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95589b14f4d84d6d89f09925c5d9b714" is_pre_election: true
I20260807 20:17:58.611791 11421 raft_consensus.cc:2454] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c9a58b62f3140cb9389f15cb9e82c2c in term 0.
I20260807 20:17:58.611794 11202 raft_consensus.cc:2454] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c9a58b62f3140cb9389f15cb9e82c2c in term 0.
I20260807 20:17:58.611953 11536 leader_election.cc:302] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31ed92fd8fd846e38674824c1ac0021a, 9c9a58b62f3140cb9389f15cb9e82c2c; no voters:
I20260807 20:17:58.612047 11855 raft_consensus.cc:2781] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:17:58.612080 11855 raft_consensus.cc:482] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:17:58.612099 11855 raft_consensus.cc:3037] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:58.612776 11855 raft_consensus.cc:504] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.612897 11855 leader_election.cc:288] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [CANDIDATE]: Term 1 election: Requested vote from peers 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249), 31ed92fd8fd846e38674824c1ac0021a (127.30.35.194:33531)
I20260807 20:17:58.613039 11421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfb711198ba647718e72e33c323a03a8" candidate_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31ed92fd8fd846e38674824c1ac0021a"
I20260807 20:17:58.613040 11202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfb711198ba647718e72e33c323a03a8" candidate_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95589b14f4d84d6d89f09925c5d9b714"
I20260807 20:17:58.613121 11202 raft_consensus.cc:3037] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:58.613121 11421 raft_consensus.cc:3037] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:17:58.613906 11202 raft_consensus.cc:2454] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c9a58b62f3140cb9389f15cb9e82c2c in term 1.
I20260807 20:17:58.613916 11421 raft_consensus.cc:2454] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c9a58b62f3140cb9389f15cb9e82c2c in term 1.
I20260807 20:17:58.614081 11540 leader_election.cc:302] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 31ed92fd8fd846e38674824c1ac0021a, 95589b14f4d84d6d89f09925c5d9b714, 9c9a58b62f3140cb9389f15cb9e82c2c; no voters:
I20260807 20:17:58.614197 11855 raft_consensus.cc:2781] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:17:58.614264 11855 raft_consensus.cc:686] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 LEADER]: Becoming Leader. State: Replica: 9c9a58b62f3140cb9389f15cb9e82c2c, State: Running, Role: LEADER
I20260807 20:17:58.614315 11855 consensus_queue.cc:237] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } }
I20260807 20:17:58.614877 10936 catalog_manager.cc:5495] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c9a58b62f3140cb9389f15cb9e82c2c (127.30.35.195). New cstate: current_term: 1 leader_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c9a58b62f3140cb9389f15cb9e82c2c" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35777 } health_report { overall_health: HEALTHY } } }
I20260807 20:17:58.653884 11777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.651517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:40733 (local address 127.30.35.195:35777)
0807 20:17:58.651563 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:17:58.651565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:17:58.651571 (+ 6us) server_negotiation.cc:407] Connection header received
0807 20:17:58.651587 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:17:58.651588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:17:58.651596 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:17:58.651631 (+ 35us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:17:58.651718 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.652218 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.653212 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.653393 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.653462 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.653590 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:17:58.653621 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:17:58.653676 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 20:17:58.653761 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 20:17:58.653782 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 20:17:58.653898 11745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.651361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:35777 (local address 127.30.35.195:40733)
0807 20:17:58.651409 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:58.651429 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 20:17:58.651468 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:17:58.651634 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:17:58.651635 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:17:58.651636 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 20:17:58.651676 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.651677 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.652294 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.652296 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.652973 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:17:58.652976 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:17:58.653467 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:17:58.653468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:17:58.653520 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:17:58.653525 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 20:17:58.653687 (+ 162us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 20:17:58.653691 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:17:58.653757 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 20:17:58.653806 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260807 20:17:58.656091 11202 raft_consensus.cc:1261] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Refusing update from remote peer 9c9a58b62f3140cb9389f15cb9e82c2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:58.656271 11923 consensus_queue.cc:1035] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "95589b14f4d84d6d89f09925c5d9b714" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 33249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:58.656322 11420 raft_consensus.cc:1261] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Refusing update from remote peer 9c9a58b62f3140cb9389f15cb9e82c2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:17:58.656497 11855 consensus_queue.cc:1035] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31ed92fd8fd846e38674824c1ac0021a" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:17:58.666039 10936 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:58.666122 10936 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:17:58.666640 10936 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6681ec7b7c064c98a99b98ac06f49530: Sending DeleteTablet for 3 replicas of tablet bfb711198ba647718e72e33c323a03a8
I20260807 20:17:58.666889 11396 tablet_service.cc:1514] Processing DeleteTablet for tablet bfb711198ba647718e72e33c323a03a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:58 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:40156
I20260807 20:17:58.666898 11182 tablet_service.cc:1514] Processing DeleteTablet for tablet bfb711198ba647718e72e33c323a03a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:58 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:56174
I20260807 20:17:58.667001 11828 tablet_replica.cc:330] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a: stopping tablet replica
I20260807 20:17:58.667068 11828 raft_consensus.cc:2229] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:58.667099 11828 raft_consensus.cc:2258] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:58.667140 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 11068
I20260807 20:17:58.667155 11829 tablet_replica.cc:330] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714: stopping tablet replica
I20260807 20:17:58.667224 11829 raft_consensus.cc:2229] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:17:58.667253 11829 raft_consensus.cc:2258] T bfb711198ba647718e72e33c323a03a8 P 95589b14f4d84d6d89f09925c5d9b714 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:58.672590 11617 tablet_service.cc:1514] Processing DeleteTablet for tablet bfb711198ba647718e72e33c323a03a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:17:58 UTC) from {username='oryx', principal='oryx/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:51464
I20260807 20:17:58.672699 11826 tablet_replica.cc:330] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c: stopping tablet replica
I20260807 20:17:58.672755 11826 raft_consensus.cc:2229] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:17:58.672799 11826 raft_consensus.cc:2258] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:17:58.673049 11828 ts_tablet_manager.cc:1905] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:58.673082 11826 ts_tablet_manager.cc:1905] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:17:58.674362 11826 ts_tablet_manager.cc:1918] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 20:17:58.674414 11826 log.cc:1196] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/bfb711198ba647718e72e33c323a03a8
I20260807 20:17:58.674520 11828 ts_tablet_manager.cc:1918] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 20:17:58.674568 11828 log.cc:1196] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/bfb711198ba647718e72e33c323a03a8
I20260807 20:17:58.674613 11826 ts_tablet_manager.cc:1939] T bfb711198ba647718e72e33c323a03a8 P 9c9a58b62f3140cb9389f15cb9e82c2c: Deleting consensus metadata
I20260807 20:17:58.674760 11828 ts_tablet_manager.cc:1939] T bfb711198ba647718e72e33c323a03a8 P 31ed92fd8fd846e38674824c1ac0021a: Deleting consensus metadata
I20260807 20:17:58.675841 10918 catalog_manager.cc:4841] TS 9c9a58b62f3140cb9389f15cb9e82c2c (127.30.35.195:35777): tablet bfb711198ba647718e72e33c323a03a8 (table test-table [id=c5732e36dda14d24b464449f0feb6dc0]) successfully deleted
I20260807 20:17:58.675984 10914 catalog_manager.cc:4841] TS 31ed92fd8fd846e38674824c1ac0021a (127.30.35.194:33531): tablet bfb711198ba647718e72e33c323a03a8 (table test-table [id=c5732e36dda14d24b464449f0feb6dc0]) successfully deleted
W20260807 20:17:58.679711 10917 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:33249 (error 108)
I20260807 20:17:58.679949 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 11296
I20260807 20:17:58.689842 11929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:17:58.680062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:33249 (local address 127.0.0.1:56178)
0807 20:17:58.689741 (+ 9679us) negotiation.cc:107] Waiting for socket to connect
0807 20:17:58.689798 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:33249: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9657,"thread_start_us":43,"threads_started":1}
W20260807 20:17:58.689985 10917 catalog_manager.cc:4584] TS 95589b14f4d84d6d89f09925c5d9b714 (127.30.35.193:33249): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bfb711198ba647718e72e33c323a03a8: Network error: Client connection negotiation failed: client connection to 127.30.35.193:33249: connect: Connection refused (error 111)
I20260807 20:17:58.692528 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 11517
I20260807 20:17:58.704754 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 10889
2026-08-07T20:17:58Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2853 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:17:58 dist-test-slave-t7g5 krb5kdc[11936](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:17:58 dist-test-slave-t7g5 krb5kdc[11936](info): set up 2 sockets
Aug 07 20:17:58 dist-test-slave-t7g5 krb5kdc[11936](info): commencing operation
krb5kdc: starting...
W20260807 20:17:59.840860 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:17:59 dist-test-slave-t7g5 krb5kdc[11936](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133879, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:17:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:17:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:17:59.957077 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:46303
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:43781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:46303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:18:00.036492 11954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:00.036701 11954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:00.036731 11954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:00.037883 11954 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:18:00.037931 11954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:00.037950 11954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:00.037968 11954 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:18:00.037982 11954 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:18:00.039417 11954 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:43781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:46303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:46303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:00.039659 11954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:00.039861 11954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 20:18:00.044613 11954 server_base.cc:1034] running on GCE node
W20260807 20:18:00.044566 11963 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:00.044555 11964 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:00.044576 11967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:00.045089 11954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:00.045368 11954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:00.046510 11954 hybrid_clock.cc:648] HybridClock initialized: now 1786133880046492 us; error 34 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T20:18:00Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1344 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:18:00 dist-test-slave-t7g5 krb5kdc[11977](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:18:00 dist-test-slave-t7g5 krb5kdc[11977](info): set up 2 sockets
Aug 07 20:18:00 dist-test-slave-t7g5 krb5kdc[11977](info): commencing operation
krb5kdc: starting...
W20260807 20:18:01.202531 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:18:01 dist-test-slave-t7g5 krb5kdc[11977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:18:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:18:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:18:01.317955 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:43467
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:32865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:43467
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:18:01.397344 11995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:01.397557 11995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:01.397585 11995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:01.398738 11995 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:18:01.398782 11995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:01.398799 11995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:01.398816 11995 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:18:01.398831 11995 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:18:01.400256 11995 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:32865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:43467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:43467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:01.400508 11995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:01.400707 11995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:01.405365 12001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:01.405555 12003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:01.405589 11995 server_base.cc:1034] running on GCE node
W20260807 20:18:01.405608 12007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:01.405947 11995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:01.406184 11995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:01.407315 11995 hybrid_clock.cc:648] HybridClock initialized: now 1786133881407306 us; error 33 us; skew 500 ppm
Aug 07 20:18:01 dist-test-slave-t7g5 krb5kdc[11977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133881, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:18:01.409638 11995 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:18:01.410146 11995 webserver.cc:460] Webserver started at http://127.30.35.254:44535/ using document root <none> and password file <none>
I20260807 20:18:01.410360 11995 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:01.410420 11995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:01.410554 11995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:01.411567 11995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "1b6cfc86e025455c87a1e5876bcab181"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "d594230e57718dc9a2f4abb150db166b"
server_key_iv: "5e77e33c75af68aa605b4bc539328f3e"
server_key_version: "encryptionkey@0"
I20260807 20:18:01.411891 11995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "1b6cfc86e025455c87a1e5876bcab181"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "d594230e57718dc9a2f4abb150db166b"
server_key_iv: "5e77e33c75af68aa605b4bc539328f3e"
server_key_version: "encryptionkey@0"
I20260807 20:18:01.413086 11995 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:18:01.413730 12017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:01.413877 11995 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:18:01.413968 11995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "1b6cfc86e025455c87a1e5876bcab181"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "d594230e57718dc9a2f4abb150db166b"
server_key_iv: "5e77e33c75af68aa605b4bc539328f3e"
server_key_version: "encryptionkey@0"
I20260807 20:18:01.414036 11995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:01.422348 11995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:01.424275 11995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:01.424405 11995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:01.428084 11995 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:43467
I20260807 20:18:01.428123 12107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:43467 every 8 connection(s)
I20260807 20:18:01.428418 11995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:18:01.429201 12108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:18:01.431298 12108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181: Bootstrap starting.
I20260807 20:18:01.431790 12108 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181: Neither blocks nor log segments found. Creating new log.
I20260807 20:18:01.431980 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 11995
I20260807 20:18:01.432091 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:18:01.432128 12108 log.cc:824] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181: Log is configured to *not* fsync() on all Append() calls
I20260807 20:18:01.432304 30863 external_mini_cluster.cc:1428] Setting key ffbe09247d5ba7e388de819b7af13c41
I20260807 20:18:01.432870 12108 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181: No bootstrap required, opened a new log
I20260807 20:18:01.435386 12108 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6cfc86e025455c87a1e5876bcab181" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43467 } }
I20260807 20:18:01.435568 12108 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:18:01.435601 12108 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b6cfc86e025455c87a1e5876bcab181, State: Initialized, Role: FOLLOWER
I20260807 20:18:01.435783 12108 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6cfc86e025455c87a1e5876bcab181" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43467 } }
I20260807 20:18:01.435914 12108 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:18:01.435941 12108 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:18:01.435988 12108 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:18:01.436527 12108 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6cfc86e025455c87a1e5876bcab181" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43467 } }
I20260807 20:18:01.436628 12108 leader_election.cc:302] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b6cfc86e025455c87a1e5876bcab181; no voters:
I20260807 20:18:01.436779 12108 leader_election.cc:288] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:18:01.436816 12115 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:18:01.436998 12108 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:18:01.437009 12115 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 1 LEADER]: Becoming Leader. State: Replica: 1b6cfc86e025455c87a1e5876bcab181, State: Running, Role: LEADER
I20260807 20:18:01.437178 12115 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6cfc86e025455c87a1e5876bcab181" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43467 } }
I20260807 20:18:01.437507 12115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b6cfc86e025455c87a1e5876bcab181. Latest consensus state: current_term: 1 leader_uuid: "1b6cfc86e025455c87a1e5876bcab181" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6cfc86e025455c87a1e5876bcab181" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43467 } } }
I20260807 20:18:01.437758 12115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [sys.catalog]: This master's current role is: LEADER
I20260807 20:18:01.437687 12121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1b6cfc86e025455c87a1e5876bcab181" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6cfc86e025455c87a1e5876bcab181" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43467 } } }
I20260807 20:18:01.438024 12121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [sys.catalog]: This master's current role is: LEADER
I20260807 20:18:01.438493 12136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:18:01.439004 12136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 20:18:01 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:18:01.440469 12136 catalog_manager.cc:1347] Generated new cluster ID: 053f9cfe5a7c4d148c0df5a1eb2d374f
I20260807 20:18:01.440526 12136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:18:01.443329 12113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:01.432737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49298 (local address 127.30.35.254:43467)
0807 20:18:01.432912 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:01.432929 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:01.432969 (+ 40us) server_negotiation.cc:407] Connection header received
0807 20:18:01.433419 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:01.433427 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:01.433488 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:01.433630 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:01.434261 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:01.435644 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:01.436462 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:01.437070 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:01.437524 (+ 454us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:01.439953 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:01.439957 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:01.439957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:18:01.439969 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:01.441843 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:01.442220 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:01.442222 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:01.442223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:01.442317 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:01.442507 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:01.442508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:01.442508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:01.442771 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:01.442901 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:01.443009 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 20:18:01.443133 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
I20260807 20:18:01.454272 12136 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:18:01.454744 12136 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:18:01.458194 12136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181: Generated new TSK 0
I20260807 20:18:01.458348 12136 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:18:01.494328 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:43467
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:32865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:18:01.589392 12150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:01.589605 12150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:01.589627 12150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:01.590831 12150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:01.590878 12150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:01.590905 12150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:18:01.592293 12150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:32865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:43467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:01.592475 12150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:01.592655 12150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:01.597306 12156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:01.597440 12150 server_base.cc:1034] running on GCE node
W20260807 20:18:01.597317 12161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:01.597482 12157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:01.597771 12150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:01.597991 12150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:01.599133 12150 hybrid_clock.cc:648] HybridClock initialized: now 1786133881599126 us; error 34 us; skew 500 ppm
Aug 07 20:18:01 dist-test-slave-t7g5 krb5kdc[11977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133881, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:18:01.601509 12150 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:18:01.602028 12150 webserver.cc:460] Webserver started at http://127.30.35.193:36801/ using document root <none> and password file <none>
I20260807 20:18:01.602238 12150 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:01.602283 12150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:01.602408 12150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:01.603433 12150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "bb873b4bb4764ea2b3fe5834b2ad0c7b"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "5e4541ae952bd952fc55c8b2adb65102"
server_key_iv: "fa46cbdbbd0dd6a8ab17de423228eb10"
server_key_version: "encryptionkey@0"
I20260807 20:18:01.603755 12150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "bb873b4bb4764ea2b3fe5834b2ad0c7b"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "5e4541ae952bd952fc55c8b2adb65102"
server_key_iv: "fa46cbdbbd0dd6a8ab17de423228eb10"
server_key_version: "encryptionkey@0"
I20260807 20:18:01.605010 12150 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:18:01.605690 12172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:01.605846 12150 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:18:01.605934 12150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "bb873b4bb4764ea2b3fe5834b2ad0c7b"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "5e4541ae952bd952fc55c8b2adb65102"
server_key_iv: "fa46cbdbbd0dd6a8ab17de423228eb10"
server_key_version: "encryptionkey@0"
I20260807 20:18:01.605988 12150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:01.622989 12150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:01.624784 12150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:01.624902 12150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:01.625102 12150 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:01.625373 12150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:01.625402 12150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:01.625427 12150 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:01.625437 12150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:01.630887 12150 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:33735
I20260807 20:18:01.630946 12362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:33735 every 8 connection(s)
I20260807 20:18:01.631296 12150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
Aug 07 20:18:01 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133881, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:18:01.639705 12113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:01.632022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:37671 (local address 127.30.35.254:43467)
0807 20:18:01.632084 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:01.632086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:01.632302 (+ 216us) server_negotiation.cc:407] Connection header received
0807 20:18:01.632762 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:01.632763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:01.632776 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:01.632837 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:01.633807 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:01.634310 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:01.635240 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:01.635432 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:01.635487 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:01.637487 (+ 2000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:01.637489 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:01.637489 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:18:01.637496 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:01.638639 (+ 1143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:01.639024 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:01.639024 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:01.639025 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:01.639076 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:01.639245 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:01.639246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:01.639246 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:01.639336 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:01.639378 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:01.639577 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 20:18:01.639638 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 20:18:01.639886 12365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:01.632003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:37671)
0807 20:18:01.632176 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:01.632219 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:01.632688 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:01.632897 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:01.632900 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:01.633479 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:01.633730 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:01.633738 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:01.634373 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:01.634374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:01.635178 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:01.635180 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:01.635493 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:01.635493 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:01.635588 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:01.636053 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:01.636063 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:01.637402 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:18:01.638703 (+ 1301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:18:01.638709 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:18:01.638711 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:18:01.638962 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:18:01.639118 (+ 156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:18:01.639119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:18:01.639119 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:18:01.639211 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:18:01.639375 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:18:01.639378 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:18:01.639491 (+ 113us) client_negotiation.cc:769] Sending connection context
0807 20:18:01.639567 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 20:18:01.639681 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":79,"threads_started":1}
I20260807 20:18:01.640322 12363 heartbeater.cc:347] Connected to a master server at 127.30.35.254:43467
I20260807 20:18:01.640413 12363 heartbeater.cc:464] Registering TS with master...
I20260807 20:18:01.640563 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 12150
I20260807 20:18:01.640584 12363 heartbeater.cc:511] Master 127.30.35.254:43467 requested a full tablet report, sending...
I20260807 20:18:01.640671 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:18:01.640842 30863 external_mini_cluster.cc:1428] Setting key 746f6b84bf01f378d67fe298879c7b28
I20260807 20:18:01.641134 12050 ts_manager.cc:194] Registered new tserver with Master: bb873b4bb4764ea2b3fe5834b2ad0c7b (127.30.35.193:33735)
I20260807 20:18:01.641856 12050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:37671
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:18:01.664599 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:43467
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:32865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:18:01.744800 12368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:01.745015 12368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:01.745045 12368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:01.746217 12368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:01.746256 12368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:01.746289 12368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:18:01.747684 12368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:32865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:43467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:01.747911 12368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:01.748118 12368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:01.752795 12375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:01.752909 12368 server_base.cc:1034] running on GCE node
W20260807 20:18:01.752820 12374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:01.752853 12379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:01.753165 12368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:01.753393 12368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:01.754529 12368 hybrid_clock.cc:648] HybridClock initialized: now 1786133881754512 us; error 32 us; skew 500 ppm
Aug 07 20:18:01 dist-test-slave-t7g5 krb5kdc[11977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133881, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:18:01.756884 12368 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:18:01.757328 12368 webserver.cc:460] Webserver started at http://127.30.35.194:38827/ using document root <none> and password file <none>
I20260807 20:18:01.757529 12368 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:01.757586 12368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:01.757742 12368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:01.758761 12368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "2c37ac8285d34ec4a5d42c5e0e0837cd"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "0212182ddf2b98ebde9ba3b64d62d734"
server_key_iv: "b0cfa6cfc67d8f896d538b16371ea32f"
server_key_version: "encryptionkey@0"
I20260807 20:18:01.759104 12368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "2c37ac8285d34ec4a5d42c5e0e0837cd"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "0212182ddf2b98ebde9ba3b64d62d734"
server_key_iv: "b0cfa6cfc67d8f896d538b16371ea32f"
server_key_version: "encryptionkey@0"
I20260807 20:18:01.760322 12368 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:18:01.760951 12387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:01.761104 12368 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:18:01.761188 12368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "2c37ac8285d34ec4a5d42c5e0e0837cd"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "0212182ddf2b98ebde9ba3b64d62d734"
server_key_iv: "b0cfa6cfc67d8f896d538b16371ea32f"
server_key_version: "encryptionkey@0"
I20260807 20:18:01.761253 12368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:01.777823 12368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:01.779544 12368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:01.779686 12368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:01.779896 12368 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:01.780207 12368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:01.780241 12368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:01.780270 12368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:01.780287 12368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:01.785578 12368 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:38629
I20260807 20:18:01.785619 12576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:38629 every 8 connection(s)
I20260807 20:18:01.785946 12368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:18:01.789062 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 12368
I20260807 20:18:01.789170 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:18:01.789397 30863 external_mini_cluster.cc:1428] Setting key 28383207f501b2c1f4b1899c6748fd1e
Aug 07 20:18:01 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133881, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:18:01.795652 12113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:01.786641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:57349 (local address 127.30.35.254:43467)
0807 20:18:01.786690 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:01.786692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:01.786885 (+ 193us) server_negotiation.cc:407] Connection header received
0807 20:18:01.787346 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:01.787347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:01.787356 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:01.787404 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:01.788300 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:01.788788 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:01.790183 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:01.790370 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:01.790422 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:01.792988 (+ 2566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:01.792990 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:01.792990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:18:01.792998 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:01.794374 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:01.794747 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:01.794748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:01.794748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:01.794807 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:01.795026 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:01.795027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:01.795027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:01.795138 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:01.795195 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:01.795472 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 20:18:01.795561 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 20:18:01.795809 12580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:01.786617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:57349)
0807 20:18:01.786773 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:01.786808 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:01.787271 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:01.787473 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:01.787477 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:01.788046 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:01.788237 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:01.788242 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:01.788903 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:01.788905 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:01.790107 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:01.790111 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:01.790447 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:01.790449 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:01.790585 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:01.791126 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:01.791137 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:01.792896 (+ 1759us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:18:01.794456 (+ 1560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:18:01.794462 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:18:01.794464 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:18:01.794670 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:18:01.794862 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:18:01.794863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:18:01.794863 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:18:01.794969 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:18:01.795195 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:18:01.795202 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:18:01.795337 (+ 135us) client_negotiation.cc:769] Sending connection context
0807 20:18:01.795435 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 20:18:01.795597 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
I20260807 20:18:01.796243 12577 heartbeater.cc:347] Connected to a master server at 127.30.35.254:43467
I20260807 20:18:01.796353 12577 heartbeater.cc:464] Registering TS with master...
I20260807 20:18:01.796550 12577 heartbeater.cc:511] Master 127.30.35.254:43467 requested a full tablet report, sending...
I20260807 20:18:01.796926 12050 ts_manager.cc:194] Registered new tserver with Master: 2c37ac8285d34ec4a5d42c5e0e0837cd (127.30.35.194:38629)
I20260807 20:18:01.797278 12050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:57349
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:18:01.814091 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:43467
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:32865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:18:01.893612 12584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:01.893826 12584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:01.893847 12584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:01.894961 12584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:01.895005 12584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:01.895056 12584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:18:01.896473 12584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:32865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:43467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:01.896677 12584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:01.896874 12584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:01.901542 12595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:01.901597 12592 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:01.901626 12584 server_base.cc:1034] running on GCE node
W20260807 20:18:01.901541 12593 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:01.901935 12584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:01.902165 12584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:01.903301 12584 hybrid_clock.cc:648] HybridClock initialized: now 1786133881903286 us; error 28 us; skew 500 ppm
Aug 07 20:18:01 dist-test-slave-t7g5 krb5kdc[11977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133881, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:18:01.905581 12584 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:18:01.906028 12584 webserver.cc:460] Webserver started at http://127.30.35.195:33739/ using document root <none> and password file <none>
I20260807 20:18:01.906250 12584 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:01.906297 12584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:01.906435 12584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:01.907452 12584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "3d45de5a19b64cb69b93f3cc53c9f075"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "f7c8eff987a08c1192cd7b90c2cf92ac"
server_key_iv: "d19aefecefb1451cd7e9639d0e8ce920"
server_key_version: "encryptionkey@0"
I20260807 20:18:01.907785 12584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "3d45de5a19b64cb69b93f3cc53c9f075"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "f7c8eff987a08c1192cd7b90c2cf92ac"
server_key_iv: "d19aefecefb1451cd7e9639d0e8ce920"
server_key_version: "encryptionkey@0"
I20260807 20:18:01.909056 12584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 20:18:01.909737 12610 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:01.909878 12584 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:18:01.909953 12584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "3d45de5a19b64cb69b93f3cc53c9f075"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "f7c8eff987a08c1192cd7b90c2cf92ac"
server_key_iv: "d19aefecefb1451cd7e9639d0e8ce920"
server_key_version: "encryptionkey@0"
I20260807 20:18:01.910023 12584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:01.924851 12584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:01.926595 12584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:01.926728 12584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:01.926936 12584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:01.927240 12584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:01.927274 12584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:01.927301 12584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:01.927325 12584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:01.932684 12584 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:46325
I20260807 20:18:01.932737 12773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:46325 every 8 connection(s)
I20260807 20:18:01.933018 12584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
Aug 07 20:18:01 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133881, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:18:01.938825 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 12584
I20260807 20:18:01.938941 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:18:01.939149 30863 external_mini_cluster.cc:1428] Setting key dde2c5d3ad8aa63bb8e751bae8e5b886
I20260807 20:18:01.941591 12113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:01.933689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:41123 (local address 127.30.35.254:43467)
0807 20:18:01.933738 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:01.933740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:01.933967 (+ 227us) server_negotiation.cc:407] Connection header received
0807 20:18:01.934418 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:01.934419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:01.934429 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:01.934474 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:01.935322 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:01.935828 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:01.936786 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:01.936975 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:01.937019 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:01.939222 (+ 2203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:01.939224 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:01.939224 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:18:01.939231 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:01.940488 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:01.940852 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:01.940853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:01.940854 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:01.940918 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:01.941109 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:01.941109 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:01.941109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:01.941213 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:01.941269 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:01.941464 (+ 195us) server_negotiation.cc:299] Negotiation successful
0807 20:18:01.941527 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:18:01.941768 12777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:01.933633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:41123)
0807 20:18:01.933824 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:01.933869 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:01.934338 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:01.934539 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:01.934542 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:01.935077 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:01.935259 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:01.935263 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:01.935885 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:01.935886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:01.936718 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:01.936721 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:01.937025 (+ 304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:01.937026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:01.937120 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:01.937585 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:01.937592 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:01.939131 (+ 1539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:18:01.940552 (+ 1421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:18:01.940558 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:18:01.940560 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:18:01.940766 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:18:01.940976 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:18:01.940976 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:18:01.940977 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:18:01.941066 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:18:01.941263 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:18:01.941266 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:18:01.941371 (+ 105us) client_negotiation.cc:769] Sending connection context
0807 20:18:01.941446 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 20:18:01.941561 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":85,"threads_started":1}
I20260807 20:18:01.942170 12775 heartbeater.cc:347] Connected to a master server at 127.30.35.254:43467
I20260807 20:18:01.942261 12775 heartbeater.cc:464] Registering TS with master...
I20260807 20:18:01.942435 12775 heartbeater.cc:511] Master 127.30.35.254:43467 requested a full tablet report, sending...
I20260807 20:18:01.942754 12050 ts_manager.cc:194] Registered new tserver with Master: 3d45de5a19b64cb69b93f3cc53c9f075 (127.30.35.195:46325)
I20260807 20:18:01.943113 12050 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:41123
I20260807 20:18:01.950614 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.193.keytab.
Entry for principal oryx/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.193.keytab.
WARNING: no policy specified for oryx/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.194.keytab.
Entry for principal oryx/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.194.keytab.
WARNING: no policy specified for oryx/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.195.keytab.
Entry for principal oryx/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.195.keytab.
I20260807 20:18:02.018080 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 12150
I20260807 20:18:02.026294 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 12368
I20260807 20:18:02.039443 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 12584
I20260807 20:18:02.045768 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 11995
I20260807 20:18:02.054610 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:43467
--webserver_interface=127.30.35.254
--webserver_port=44535
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:32865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:43467
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:18:02.135617 12786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:02.135818 12786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:02.135839 12786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:02.136906 12786 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:18:02.136940 12786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:02.136952 12786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:02.136963 12786 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:18:02.136977 12786 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:18:02.138437 12786 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:32865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:43467
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:43467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=44535
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:02.138629 12786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:02.138798 12786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:02.143348 12804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:02.143337 12793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:02.143404 12797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:02.143554 12786 server_base.cc:1034] running on GCE node
I20260807 20:18:02.143779 12786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:02.144030 12786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:02.145172 12786 hybrid_clock.cc:648] HybridClock initialized: now 1786133882145158 us; error 32 us; skew 500 ppm
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133882, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:18:02.147616 12786 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:18:02.148036 12786 webserver.cc:460] Webserver started at http://127.30.35.254:44535/ using document root <none> and password file <none>
I20260807 20:18:02.148218 12786 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:02.148269 12786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:02.149514 12786 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:18:02.150139 12816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:02.150287 12786 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:02.150370 12786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "1b6cfc86e025455c87a1e5876bcab181"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "d594230e57718dc9a2f4abb150db166b"
server_key_iv: "5e77e33c75af68aa605b4bc539328f3e"
server_key_version: "encryptionkey@0"
I20260807 20:18:02.150707 12786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:02.165594 12786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:02.167357 12786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:02.167495 12786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:02.171268 12786 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:43467
I20260807 20:18:02.171306 12891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:43467 every 8 connection(s)
I20260807 20:18:02.171660 12786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:18:02.173084 12894 sys_catalog.cc:263] Verifying existing consensus state
I20260807 20:18:02.173713 12894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181: Bootstrap starting.
I20260807 20:18:02.179380 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 12786
I20260807 20:18:02.179726 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:33735
--local_ip_for_outbound_sockets=127.30.35.193
--tserver_master_addrs=127.30.35.254:43467
--webserver_port=36801
--webserver_interface=127.30.35.193
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:32865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.35.193
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:18:02.182147 12894 log.cc:824] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181: Log is configured to *not* fsync() on all Append() calls
I20260807 20:18:02.183749 12894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 20:18:02.183995 12894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181: Bootstrap complete.
I20260807 20:18:02.186076 12894 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6cfc86e025455c87a1e5876bcab181" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43467 } }
I20260807 20:18:02.186295 12894 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b6cfc86e025455c87a1e5876bcab181, State: Initialized, Role: FOLLOWER
I20260807 20:18:02.186467 12894 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6cfc86e025455c87a1e5876bcab181" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43467 } }
I20260807 20:18:02.186548 12894 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:18:02.186599 12894 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:18:02.186643 12894 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 1 FOLLOWER]: Advancing to term 2
I20260807 20:18:02.187600 12894 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6cfc86e025455c87a1e5876bcab181" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43467 } }
I20260807 20:18:02.187697 12894 leader_election.cc:302] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1b6cfc86e025455c87a1e5876bcab181; no voters:
I20260807 20:18:02.187855 12894 leader_election.cc:288] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 20:18:02.187932 12899 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 20:18:02.188109 12894 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:18:02.188133 12899 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [term 2 LEADER]: Becoming Leader. State: Replica: 1b6cfc86e025455c87a1e5876bcab181, State: Running, Role: LEADER
I20260807 20:18:02.188257 12899 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6cfc86e025455c87a1e5876bcab181" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43467 } }
I20260807 20:18:02.188549 12900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1b6cfc86e025455c87a1e5876bcab181" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6cfc86e025455c87a1e5876bcab181" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43467 } } }
I20260807 20:18:02.189704 12900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [sys.catalog]: This master's current role is: LEADER
I20260807 20:18:02.189823 12926 catalog_manager.cc:1259] Loaded cluster ID: 053f9cfe5a7c4d148c0df5a1eb2d374f
I20260807 20:18:02.189811 12904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b6cfc86e025455c87a1e5876bcab181. Latest consensus state: current_term: 2 leader_uuid: "1b6cfc86e025455c87a1e5876bcab181" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1b6cfc86e025455c87a1e5876bcab181" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43467 } } }
I20260807 20:18:02.189991 12904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181 [sys.catalog]: This master's current role is: LEADER
I20260807 20:18:02.189976 12926 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181: loading cluster ID for follower catalog manager: success
I20260807 20:18:02.191162 12926 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181: acquiring CA information for follower catalog manager: success
I20260807 20:18:02.191514 12926 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 20:18:02.191642 12933 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:18:02.191798 12933 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:18:02.191897 12933 catalog_manager.cc:1259] Loaded cluster ID: 053f9cfe5a7c4d148c0df5a1eb2d374f
I20260807 20:18:02.191974 12933 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:18:02.192158 12933 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:18:02.192266 12933 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1b6cfc86e025455c87a1e5876bcab181: Loaded TSK: 0
I20260807 20:18:02.192421 12933 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 20:18:02.264312 12896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:02.264520 12896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:02.264541 12896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:02.265674 12896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:02.265725 12896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:02.265755 12896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:18:02.267131 12896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:32865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.193.keytab
--principal=oryx/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:33735
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=36801
--tserver_master_addrs=127.30.35.254:43467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:02.267333 12896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:02.267549 12896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:02.272049 12944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:02.272059 12940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:02.272059 12942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:02.272632 12896 server_base.cc:1034] running on GCE node
I20260807 20:18:02.272876 12896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:02.273147 12896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:02.274328 12896 hybrid_clock.cc:648] HybridClock initialized: now 1786133882274308 us; error 32 us; skew 500 ppm
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133882, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:18:02.280946 12896 init.cc:377] Logged in from keytab as oryx/127.30.35.193@KRBTEST.COM (short username oryx)
I20260807 20:18:02.281489 12896 webserver.cc:460] Webserver started at http://127.30.35.193:36801/ using document root <none> and password file <none>
I20260807 20:18:02.281762 12896 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:02.281844 12896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:02.283533 12896 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 20:18:02.284168 12955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:02.284334 12896 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:18:02.284425 12896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "bb873b4bb4764ea2b3fe5834b2ad0c7b"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "5e4541ae952bd952fc55c8b2adb65102"
server_key_iv: "fa46cbdbbd0dd6a8ab17de423228eb10"
server_key_version: "encryptionkey@0"
I20260807 20:18:02.284761 12896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:02.309242 12896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:02.311317 12896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:02.311437 12896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:02.311728 12896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:02.312079 12896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:02.312117 12896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:02.312146 12896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:02.312163 12896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:02.317602 12896 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:33735
I20260807 20:18:02.317669 13141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:33735 every 8 connection(s)
I20260807 20:18:02.317997 12896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:02.325374 13145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:02.318690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:40117)
0807 20:18:02.318866 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:02.318908 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:02.319380 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:02.319712 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:02.319715 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:02.320265 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:02.320453 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.320458 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.321437 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.321438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.322243 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.322245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.322759 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.322759 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.322848 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.323250 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:02.323258 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:02.325239 (+ 1981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
W20260807 20:18:02.325517 13146 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:02.318753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:40117 (local address 127.30.35.254:43467)
0807 20:18:02.318923 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:02.318930 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:02.318994 (+ 64us) server_negotiation.cc:407] Connection header received
0807 20:18:02.319528 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:02.319533 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:02.319574 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:02.319680 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:02.320536 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.321365 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.322310 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.322701 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.322774 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.325359 (+ 2585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:40117: BlockingRecv error: recv got EOF from 127.30.35.193:40117 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
W20260807 20:18:02.325647 13142 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:43467 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.35.254:43467: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
I20260807 20:18:02.325637 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 12896
I20260807 20:18:02.325968 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:38629
--local_ip_for_outbound_sockets=127.30.35.194
--tserver_master_addrs=127.30.35.254:43467
--webserver_port=38827
--webserver_interface=127.30.35.194
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:32865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.35.194
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:02.330188 13145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:02.325894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:35249)
0807 20:18:02.326004 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:02.326015 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:02.326067 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:02.326303 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:02.326303 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:02.326440 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:02.326491 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.326492 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.327051 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.327052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.327684 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.327685 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.328090 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.328090 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.328132 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.328469 (+ 337us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:02.328474 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:02.330124 (+ 1650us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":92}
W20260807 20:18:02.330296 13146 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:02.325955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:35249 (local address 127.30.35.254:43467)
0807 20:18:02.326004 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:02.326006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:02.326212 (+ 206us) server_negotiation.cc:407] Connection header received
0807 20:18:02.326232 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:02.326232 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:02.326242 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:02.326288 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:02.326550 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.326990 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.327761 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.328022 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.328083 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.330199 (+ 2116us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:35249: BlockingRecv error: recv got EOF from 127.30.35.193:35249 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:02.334436 13145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:02.330402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:58681)
0807 20:18:02.330454 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:02.330465 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:02.330509 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:02.330699 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:02.330700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:02.330832 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:02.330861 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.330862 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.331400 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.331401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.332115 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.332117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.332397 (+ 280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.332398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.332454 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.332757 (+ 303us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:02.332762 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:02.334393 (+ 1631us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260807 20:18:02.334559 13146 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:02.330452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:58681 (local address 127.30.35.254:43467)
0807 20:18:02.330616 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:02.330617 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:02.330624 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:18:02.330640 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:02.330641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:02.330648 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:02.330689 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:02.330926 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.331339 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.332182 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.332342 (+ 160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.332381 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.334501 (+ 2120us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:58681: BlockingRecv error: recv got EOF from 127.30.35.193:58681 (error 108)
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":77,"threads_started":1}
W20260807 20:18:02.334630 13142 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 20:18:02.407379 13149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:02.407579 13149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:02.407610 13149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:02.408708 13149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:02.408747 13149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:02.408782 13149 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:18:02.410198 13149 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:32865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.194.keytab
--principal=oryx/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:38629
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=38827
--tserver_master_addrs=127.30.35.254:43467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:02.410413 13149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:02.410614 13149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:02.415422 13165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:02.415432 13162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:02.415499 13168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:02.415499 13149 server_base.cc:1034] running on GCE node
I20260807 20:18:02.415831 13149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:02.416044 13149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:02.417181 13149 hybrid_clock.cc:648] HybridClock initialized: now 1786133882417165 us; error 31 us; skew 500 ppm
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133882, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:18:02.419577 13149 init.cc:377] Logged in from keytab as oryx/127.30.35.194@KRBTEST.COM (short username oryx)
I20260807 20:18:02.419962 13149 webserver.cc:460] Webserver started at http://127.30.35.194:38827/ using document root <none> and password file <none>
I20260807 20:18:02.420163 13149 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:02.420224 13149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:02.421478 13149 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:18:02.422039 13177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:02.422184 13149 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:02.422264 13149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "2c37ac8285d34ec4a5d42c5e0e0837cd"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "0212182ddf2b98ebde9ba3b64d62d734"
server_key_iv: "b0cfa6cfc67d8f896d538b16371ea32f"
server_key_version: "encryptionkey@0"
I20260807 20:18:02.422571 13149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:02.435168 13149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:02.436714 13149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:02.436841 13149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:02.437038 13149 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:02.437304 13149 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:02.437336 13149 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:02.437362 13149 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:02.437379 13149 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:02.442692 13149 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:38629
I20260807 20:18:02.442727 13352 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:38629 every 8 connection(s)
I20260807 20:18:02.443032 13149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:02.449481 13358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:02.443647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:40553)
0807 20:18:02.443805 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:02.443838 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:02.444281 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:02.444497 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:02.444500 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:02.445032 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:02.445210 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.445215 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.445880 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.445881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.446661 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.446662 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.446953 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.446954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.447045 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.447437 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:02.447444 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:02.449345 (+ 1901us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":92,"threads_started":1}
W20260807 20:18:02.449491 13146 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:02.443658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:40553 (local address 127.30.35.254:43467)
0807 20:18:02.443719 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:02.443722 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:02.443926 (+ 204us) server_negotiation.cc:407] Connection header received
0807 20:18:02.444370 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:02.444371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:02.444384 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:02.444426 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:02.445275 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.445812 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.446719 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.446891 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.446944 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.449442 (+ 2498us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:40553: BlockingRecv error: recv got EOF from 127.30.35.194:40553 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260807 20:18:02.449746 13356 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:43467 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.35.254:43467: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
I20260807 20:18:02.451469 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 13149
I20260807 20:18:02.451774 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:46325
--local_ip_for_outbound_sockets=127.30.35.195
--tserver_master_addrs=127.30.35.254:43467
--webserver_port=33739
--webserver_interface=127.30.35.195
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:32865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.30.35.195
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:02.453881 13358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:02.449941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:56681)
0807 20:18:02.449997 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:02.450006 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:02.450039 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:02.450145 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:02.450145 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:02.450248 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:02.450291 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.450292 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.450827 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.450827 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.451326 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.451328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.451735 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.451735 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.451785 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.452121 (+ 336us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:02.452125 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:02.453824 (+ 1699us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":44}
W20260807 20:18:02.453965 13146 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:02.450002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:56681 (local address 127.30.35.254:43467)
0807 20:18:02.450052 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:02.450053 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:02.450060 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:18:02.450082 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:02.450082 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:02.450091 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:02.450138 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:02.450337 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.450778 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.451402 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.451669 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.451735 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.453912 (+ 2177us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:56681: BlockingRecv error: recv got EOF from 127.30.35.194:56681 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:02.458158 13358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:02.454220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:54693)
0807 20:18:02.454253 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:02.454264 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:02.454305 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:02.454407 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:02.454408 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:02.454542 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:02.454571 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.454573 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.455126 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.455128 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.455813 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.455815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.456111 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.456112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.456163 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.456489 (+ 326us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:02.456494 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:02.458097 (+ 1603us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":17}
W20260807 20:18:02.458266 13146 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:02.454270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:54693 (local address 127.30.35.254:43467)
0807 20:18:02.454304 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:02.454306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:02.454314 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:18:02.454356 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:02.454356 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:02.454363 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:02.454403 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:02.454629 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.455061 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.455879 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.456045 (+ 166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.456084 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.458164 (+ 2080us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:54693: BlockingRecv error: recv got EOF from 127.30.35.194:54693 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260807 20:18:02.458274 13356 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 20:18:02.532763 13359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:02.532979 13359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:02.533001 13359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:02.534114 13359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:02.534148 13359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:02.534173 13359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:18:02.535552 13359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:32865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/krb5kdc/oryx_127.30.35.195.keytab
--principal=oryx/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:46325
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=33739
--tserver_master_addrs=127.30.35.254:43467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:02.535728 13359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:02.535898 13359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:02.540583 13375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:02.540607 13370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:02.540588 13368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:02.540846 13359 server_base.cc:1034] running on GCE node
I20260807 20:18:02.541060 13359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:02.541280 13359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:02.542423 13359 hybrid_clock.cc:648] HybridClock initialized: now 1786133882542405 us; error 27 us; skew 500 ppm
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133882, etypes {rep=17 tkt=17 ses=17}, oryx/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:18:02.544742 13359 init.cc:377] Logged in from keytab as oryx/127.30.35.195@KRBTEST.COM (short username oryx)
I20260807 20:18:02.545147 13359 webserver.cc:460] Webserver started at http://127.30.35.195:33739/ using document root <none> and password file <none>
I20260807 20:18:02.545343 13359 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:02.545414 13359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:02.546700 13359 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:18:02.547248 13384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:02.547394 13359 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:18:02.547488 13359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "3d45de5a19b64cb69b93f3cc53c9f075"
format_stamp: "Formatted at 2026-08-07 20:18:01 on dist-test-slave-t7g5"
server_key: "f7c8eff987a08c1192cd7b90c2cf92ac"
server_key_iv: "d19aefecefb1451cd7e9639d0e8ce920"
server_key_version: "encryptionkey@0"
I20260807 20:18:02.547922 13359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:02.595067 13359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:02.596892 13359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:02.597009 13359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:02.597210 13359 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:02.597486 13359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:02.597517 13359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:02.597538 13359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:02.597555 13359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:02.602988 13359 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:46325
I20260807 20:18:02.603082 13569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:46325 every 8 connection(s)
I20260807 20:18:02.603377 13359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:18:02.608278 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 13359
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
W20260807 20:18:02.610386 13146 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:02.604053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:51083 (local address 127.30.35.254:43467)
0807 20:18:02.604139 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:02.604141 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:02.604328 (+ 187us) server_negotiation.cc:407] Connection header received
0807 20:18:02.604789 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:02.604790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:02.604801 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:02.604850 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:02.605789 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.606281 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.607207 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.607407 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.607456 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.610339 (+ 2883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:51083: BlockingRecv error: recv got EOF from 127.30.35.195:51083 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 20:18:02.610481 13573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:02.604035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:51083)
0807 20:18:02.604210 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:02.604247 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:02.604707 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:02.604917 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:02.604921 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:02.605481 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:02.605713 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.605720 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.606343 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.606343 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.607144 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.607146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.607470 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.607471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.607568 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.607978 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:02.607987 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:02.610279 (+ 2292us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":98,"threads_started":1}
W20260807 20:18:02.610669 13570 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:43467 (0 consecutive failures): Not authorized: Failed to ping master at 127.30.35.254:43467: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:02.615125 13573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:02.610899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:44797)
0807 20:18:02.610942 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:02.610952 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:02.610992 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:02.611100 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:02.611100 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:02.611200 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:02.611240 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.611242 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.611904 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.611905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.612511 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.612514 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.612921 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.612922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.612984 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.613391 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:02.613396 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:02.615064 (+ 1668us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260807 20:18:02.615159 13146 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:02.610951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:44797 (local address 127.30.35.254:43467)
0807 20:18:02.610996 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:02.610998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:02.611025 (+ 27us) server_negotiation.cc:407] Connection header received
0807 20:18:02.611044 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:02.611045 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:02.611053 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:02.611091 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:02.611293 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.611834 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.612590 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.612861 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.612915 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.615106 (+ 2191us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:44797: BlockingRecv error: recv got EOF from 127.30.35.195:44797 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:18:02.615944 13154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:02.608858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49306 (local address 127.30.35.254:43467)
0807 20:18:02.608929 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:02.608930 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:02.608939 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:18:02.609021 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:02.609022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:02.609031 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:02.609089 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:02.609739 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.610449 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.611380 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.611568 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.611615 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.612823 (+ 1208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:02.612827 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:02.612827 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:18:02.612837 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:02.614476 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:02.614847 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:02.614850 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:02.614850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:02.614955 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:02.615167 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:02.615168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:02.615169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:02.615477 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:02.615606 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:02.615750 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 20:18:02.615861 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:02 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:02.618970 13573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:02.615320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:44901)
0807 20:18:02.615366 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:02.615377 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:02.615415 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:02.615526 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:02.615527 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:02.615654 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:02.615685 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.615687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.616363 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.616364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.616961 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:02.616964 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.617236 (+ 272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.617237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:02.617268 (+ 31us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.617539 (+ 271us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:02.617542 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:02.618932 (+ 1390us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":30}
W20260807 20:18:02.619077 13570 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 20:18:02.619127 13146 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:02.615377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:44901 (local address 127.30.35.254:43467)
0807 20:18:02.615422 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:02.615424 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:02.615449 (+ 25us) server_negotiation.cc:407] Connection header received
0807 20:18:02.615476 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:02.615476 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:02.615483 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:02.615520 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:02.615762 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.616303 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.617019 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:02.617186 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:02.617234 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:02.619080 (+ 1846us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:44901: BlockingRecv error: recv got EOF from 127.30.35.195:44901 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
Aug 07 20:18:03 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:03 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:03.339720 13577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:03.335015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:54451)
0807 20:18:03.335137 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:03.335148 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:03.335201 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:03.335327 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:03.335328 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:03.335512 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:03.335564 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:03.335565 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:03.336386 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:03.336387 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:03.337132 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:03.337135 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:03.337461 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:03.337462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:03.337498 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:03.337928 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:03.337933 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:03.339629 (+ 1696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":74,"threads_started":1}
W20260807 20:18:03.339800 13578 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:03.335101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:54451 (local address 127.30.35.254:43467)
0807 20:18:03.335218 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:03.335220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:03.335228 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:18:03.335250 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:03.335251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:03.335261 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:03.335317 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:03.335620 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:03.336312 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:03.337206 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:03.337403 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:03.337460 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:03.339726 (+ 2266us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:54451: BlockingRecv error: recv got EOF from 127.30.35.193:54451 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":58,"threads_started":1}
Aug 07 20:18:03 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:03 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:03.462813 13579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:03.458588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:53525)
0807 20:18:03.458708 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:03.458718 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:03.458772 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:03.458880 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:03.458881 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:03.459065 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:03.459117 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:03.459119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:03.459710 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:03.459710 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:03.460267 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:03.460268 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:03.460550 (+ 282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:03.460550 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:03.460587 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:03.461018 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:03.461022 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:03.462742 (+ 1720us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":60,"threads_started":1}
W20260807 20:18:03.462898 13578 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:03.458649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:53525 (local address 127.30.35.254:43467)
0807 20:18:03.458702 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:03.458704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:03.458758 (+ 54us) server_negotiation.cc:407] Connection header received
0807 20:18:03.458812 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:03.458813 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:03.458823 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:03.458869 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:03.459167 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:03.459658 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:03.460318 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:03.460504 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:03.460546 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:03.462838 (+ 2292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:53525: BlockingRecv error: recv got EOF from 127.30.35.194:53525 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 07 20:18:03 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:03 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:03.623672 13582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:03.619428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:40471)
0807 20:18:03.619552 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:03.619562 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:03.619619 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:03.619733 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:03.619733 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:03.619915 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:03.619965 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:03.619967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:03.620560 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:03.620561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:03.621106 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:03.621108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:03.621379 (+ 271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:03.621380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:03.621417 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:03.621836 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:03.621841 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:03.623578 (+ 1737us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
W20260807 20:18:03.623729 13578 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:03.619469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:40471 (local address 127.30.35.254:43467)
0807 20:18:03.619522 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:03.619524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:03.619616 (+ 92us) server_negotiation.cc:407] Connection header received
0807 20:18:03.619660 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:03.619660 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:03.619672 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:03.619722 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:03.620016 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:03.620505 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:03.621158 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:03.621331 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:03.621374 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:03.623677 (+ 2303us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:40471: BlockingRecv error: recv got EOF from 127.30.35.195:40471 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 07 20:18:04 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:04 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:04.344359 13583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:04.340107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:50555)
0807 20:18:04.340221 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:04.340231 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:04.340277 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:04.340392 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:04.340393 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:04.340552 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:04.340602 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:04.340604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:04.341231 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:04.341232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:04.341959 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:04.341962 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:04.342279 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:04.342280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:04.342316 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:04.342711 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:04.342715 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:04.344297 (+ 1582us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":59,"threads_started":1}
W20260807 20:18:04.344460 13584 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:04.340167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:50555 (local address 127.30.35.254:43467)
0807 20:18:04.340283 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:04.340285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:04.340293 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:18:04.340315 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:04.340316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:04.340326 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:04.340382 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:04.340653 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:04.341157 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:04.342032 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:04.342232 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:04.342277 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:04.344387 (+ 2110us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:50555: BlockingRecv error: recv got EOF from 127.30.35.193:50555 (error 108)
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":60,"threads_started":1}
Aug 07 20:18:04 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:04 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:04.467535 13585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:04.463259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:34287)
0807 20:18:04.463393 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:04.463407 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:04.463478 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:04.463607 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:04.463608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:04.463791 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:04.463849 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:04.463851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:04.464513 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:04.464514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:04.465037 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:04.465038 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:04.465367 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:04.465368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:04.465426 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:04.465854 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:04.465858 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:04.467458 (+ 1600us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
W20260807 20:18:04.467698 13584 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:04.463342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:34287 (local address 127.30.35.254:43467)
0807 20:18:04.463419 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:04.463421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:04.463459 (+ 38us) server_negotiation.cc:407] Connection header received
0807 20:18:04.463534 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:04.463535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:04.463548 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:04.463594 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:04.463924 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:04.464439 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:04.465114 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:04.465308 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:04.465363 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:04.467641 (+ 2278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:34287: BlockingRecv error: recv got EOF from 127.30.35.194:34287 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 07 20:18:04 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:04 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:04.628742 13588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:04.624131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:55123)
0807 20:18:04.624244 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:04.624253 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:04.624308 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:04.624454 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:04.624455 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:04.624624 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:04.624672 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:04.624674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:04.625367 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:04.625369 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:04.625937 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:04.625940 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:04.626261 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:04.626262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:04.626317 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:04.626703 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:04.626707 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:04.628664 (+ 1957us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":57,"threads_started":1}
W20260807 20:18:04.628814 13584 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:04.624252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:55123 (local address 127.30.35.254:43467)
0807 20:18:04.624309 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:04.624311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:04.624319 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:18:04.624364 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:04.624365 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:04.624378 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:04.624446 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:04.624737 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:04.625298 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:04.626006 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:04.626202 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:04.626262 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:04.628762 (+ 2500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:55123: BlockingRecv error: recv got EOF from 127.30.35.195:55123 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 07 20:18:05 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:05 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:05.349202 13590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:05.344892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:44303)
0807 20:18:05.345029 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:05.345039 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:05.345088 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:05.345206 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:05.345206 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:05.345369 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:05.345429 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:05.345430 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:05.346097 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:05.346098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:05.346612 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:05.346614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:05.346973 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:05.346974 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:05.347011 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:05.347427 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:05.347431 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:05.349140 (+ 1709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
W20260807 20:18:05.349291 13591 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:05.344977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:44303 (local address 127.30.35.254:43467)
0807 20:18:05.345096 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:05.345098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:05.345106 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:18:05.345128 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:05.345128 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:05.345138 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:05.345190 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:05.345487 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:05.346038 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:05.346688 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:05.346904 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:05.346971 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:05.349224 (+ 2253us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:44303: BlockingRecv error: recv got EOF from 127.30.35.193:44303 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":57,"threads_started":1}
Aug 07 20:18:05 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:05 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:05.472471 13592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:05.467980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:37189)
0807 20:18:05.468140 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:05.468151 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:05.468216 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:05.468345 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:05.468346 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:05.468528 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:05.468576 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:05.468578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:05.469223 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:05.469224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:05.469801 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:05.469803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:05.470129 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:05.470130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:05.470188 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:05.470643 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:05.470647 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:05.472393 (+ 1746us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":89,"threads_started":1}
W20260807 20:18:05.472563 13591 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:05.468051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:37189 (local address 127.30.35.254:43467)
0807 20:18:05.468108 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:05.468110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:05.468203 (+ 93us) server_negotiation.cc:407] Connection header received
0807 20:18:05.468274 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:05.468275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:05.468287 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:05.468334 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:05.468643 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:05.469150 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:05.469879 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:05.470072 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:05.470124 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:05.472507 (+ 2383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:37189: BlockingRecv error: recv got EOF from 127.30.35.194:37189 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 07 20:18:05 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:05 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:05.633332 13596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:05.629193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:58107)
0807 20:18:05.629320 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:05.629330 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:05.629382 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:05.629502 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:05.629503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:05.629701 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:05.629753 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:05.629755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:05.630329 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:05.630330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:05.630839 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:05.630841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:05.631101 (+ 260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:05.631102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:05.631137 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:05.631577 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:05.631581 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:05.633253 (+ 1672us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":62,"threads_started":1}
W20260807 20:18:05.633397 13591 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:05.629252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:58107 (local address 127.30.35.254:43467)
0807 20:18:05.629301 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:05.629302 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:05.629379 (+ 77us) server_negotiation.cc:407] Connection header received
0807 20:18:05.629429 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:05.629430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:05.629440 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:05.629491 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:05.629805 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:05.630279 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:05.630890 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:05.631057 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:05.631096 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:05.633346 (+ 2250us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:58107: BlockingRecv error: recv got EOF from 127.30.35.195:58107 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 07 20:18:06 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:06 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:06.354029 13597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:06.349634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:48219)
0807 20:18:06.349788 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:06.349798 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:06.349841 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:06.350002 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:06.350003 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:06.350175 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:06.350223 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:06.350225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:06.350864 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:06.350865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:06.351377 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:06.351379 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:06.351706 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:06.351707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:06.351761 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:06.352201 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:06.352206 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:06.353950 (+ 1744us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":101,"threads_started":1}
W20260807 20:18:06.354112 13598 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:06.349713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:48219 (local address 127.30.35.254:43467)
0807 20:18:06.349818 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:06.349820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:06.349842 (+ 22us) server_negotiation.cc:407] Connection header received
0807 20:18:06.349898 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:06.349899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:06.349922 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:06.349975 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:06.350293 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:06.350792 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:06.351450 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:06.351648 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:06.351702 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:06.354050 (+ 2348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:48219: BlockingRecv error: recv got EOF from 127.30.35.193:48219 (error 108)
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":50,"threads_started":1}
Aug 07 20:18:06 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:06 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:06.477563 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:06.472940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:46479)
0807 20:18:06.473081 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:06.473093 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:06.473160 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:06.473293 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:06.473294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:06.473467 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:06.473516 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:06.473518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:06.474237 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:06.474239 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:06.474763 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:06.474765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:06.475121 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:06.475122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:06.475177 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:06.475648 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:06.475653 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:06.477482 (+ 1829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":72,"threads_started":1}
W20260807 20:18:06.477679 13598 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:06.473003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:46479 (local address 127.30.35.254:43467)
0807 20:18:06.473065 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:06.473067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:06.473151 (+ 84us) server_negotiation.cc:407] Connection header received
0807 20:18:06.473222 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:06.473223 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:06.473234 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:06.473284 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:06.473582 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:06.474168 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:06.474843 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:06.475060 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:06.475120 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:06.477598 (+ 2478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:46479: BlockingRecv error: recv got EOF from 127.30.35.194:46479 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 07 20:18:06 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:06 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:06.638126 13600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:06.633800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:33369)
0807 20:18:06.633955 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:06.633966 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:06.634022 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:06.634132 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:06.634132 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:06.634292 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:06.634344 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:06.634346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:06.634976 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:06.634977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:06.635532 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:06.635534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:06.635827 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:06.635828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:06.635874 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:06.636282 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:06.636287 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:06.638047 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":59,"threads_started":1}
W20260807 20:18:06.638197 13598 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:06.633857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:33369 (local address 127.30.35.254:43467)
0807 20:18:06.633901 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:06.633903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:06.634018 (+ 115us) server_negotiation.cc:407] Connection header received
0807 20:18:06.634061 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:06.634062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:06.634073 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:06.634120 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:06.634392 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:06.634885 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:06.635597 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:06.635769 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:06.635810 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:06.638144 (+ 2334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:33369: BlockingRecv error: recv got EOF from 127.30.35.195:33369 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 07 20:18:07 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:07 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:07.361681 13602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:07.354461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:57307)
0807 20:18:07.354585 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:07.354595 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:07.354641 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:07.354765 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:07.354766 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:07.354932 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:07.354983 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:07.354985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:07.355597 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:07.355597 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:07.356172 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:07.356176 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:07.356465 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:07.356465 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:07.356501 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:07.359774 (+ 3273us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:07.359779 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:07.361568 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
W20260807 20:18:07.361768 13603 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:07.354512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:57307 (local address 127.30.35.254:43467)
0807 20:18:07.354622 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:07.354624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:07.354633 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:18:07.354689 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:07.354689 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:07.354699 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:07.354756 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:07.355031 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:07.355544 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:07.356231 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:07.356419 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:07.356461 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:07.361702 (+ 5241us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:57307: BlockingRecv error: recv got EOF from 127.30.35.193:57307 (error 108)
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":54,"threads_started":1}
Aug 07 20:18:07 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:07 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:07.482282 13605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:07.478039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:40929)
0807 20:18:07.478160 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:07.478170 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:07.478213 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:07.478335 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:07.478335 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:07.478494 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:07.478546 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:07.478547 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:07.479139 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:07.479139 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:07.479680 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:07.479681 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:07.479998 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:07.479999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:07.480054 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:07.480463 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:07.480467 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:07.482222 (+ 1755us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
W20260807 20:18:07.482374 13603 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:07.478149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:40929 (local address 127.30.35.254:43467)
0807 20:18:07.478196 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:07.478198 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:07.478206 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:18:07.478265 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:07.478265 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:07.478275 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:07.478324 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:07.478595 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:07.479079 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:07.479734 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:07.479913 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:07.479958 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:07.482311 (+ 2353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:40929: BlockingRecv error: recv got EOF from 127.30.35.194:40929 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 07 20:18:07 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:07 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:07.642931 13606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:07.638563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:52451)
0807 20:18:07.638713 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:07.638725 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:07.638789 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:07.638910 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:07.638911 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:07.639094 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:07.639142 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:07.639144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:07.639777 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:07.639778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:07.640293 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:07.640294 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:07.640623 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:07.640624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:07.640679 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:07.641121 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:07.641125 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:07.642850 (+ 1725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":88,"threads_started":1}
W20260807 20:18:07.643011 13603 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:07.638643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:52451 (local address 127.30.35.254:43467)
0807 20:18:07.638706 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:07.638708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:07.638779 (+ 71us) server_negotiation.cc:407] Connection header received
0807 20:18:07.638840 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:07.638841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:07.638854 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:07.638904 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:07.639214 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:07.639706 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:07.640371 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:07.640562 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:07.640617 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:07.642959 (+ 2342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:52451: BlockingRecv error: recv got EOF from 127.30.35.195:52451 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 07 20:18:08 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:08 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:08.366344 13607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:08.362098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:47095)
0807 20:18:08.362244 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:08.362256 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:08.362312 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:08.362439 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:08.362439 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:08.362605 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:08.362656 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:08.362658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:08.363297 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:08.363298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:08.363870 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:08.363872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:08.364174 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:08.364175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:08.364210 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:08.364615 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:08.364619 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:08.366283 (+ 1664us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":89,"threads_started":1}
W20260807 20:18:08.366458 13609 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:08.362163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:47095 (local address 127.30.35.254:43467)
0807 20:18:08.362266 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:08.362268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:08.362299 (+ 31us) server_negotiation.cc:407] Connection header received
0807 20:18:08.362360 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:08.362360 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:08.362371 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:08.362427 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:08.362705 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:08.363230 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:08.363943 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:08.364129 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:08.364171 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:08.366378 (+ 2207us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:47095: BlockingRecv error: recv got EOF from 127.30.35.193:47095 (error 108)
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":47,"threads_started":1}
Aug 07 20:18:08 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:08 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:08.486768 13610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:08.482708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:41091)
0807 20:18:08.482827 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:08.482838 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:08.482897 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:08.483019 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:08.483020 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:08.483182 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:08.483232 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:08.483233 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:08.483824 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:08.483825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:08.484356 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:08.484357 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:08.484635 (+ 278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:08.484635 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:08.484671 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:08.485076 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:08.485080 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:08.486694 (+ 1614us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":60,"threads_started":1}
W20260807 20:18:08.486838 13609 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:08.482768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:41091 (local address 127.30.35.254:43467)
0807 20:18:08.482842 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:08.482844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:08.482881 (+ 37us) server_negotiation.cc:407] Connection header received
0807 20:18:08.482958 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:08.482959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:08.482969 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:08.483008 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:08.483277 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:08.483774 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:08.484417 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:08.484590 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:08.484631 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:08.486786 (+ 2155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:41091: BlockingRecv error: recv got EOF from 127.30.35.194:41091 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 07 20:18:08 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:08 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:08.647576 13611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:08.643419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:45911)
0807 20:18:08.643555 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:08.643565 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:08.643620 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:08.643738 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:08.643739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:08.643914 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:08.643966 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:08.643967 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:08.644553 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:08.644554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:08.645069 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:08.645070 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:08.645334 (+ 264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:08.645334 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:08.645368 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:08.645864 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:08.645869 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:08.647518 (+ 1649us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":61,"threads_started":1}
W20260807 20:18:08.647686 13609 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:08.643472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:45911 (local address 127.30.35.254:43467)
0807 20:18:08.643519 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:08.643521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:08.643609 (+ 88us) server_negotiation.cc:407] Connection header received
0807 20:18:08.643674 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:08.643674 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:08.643686 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:08.643722 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:08.644020 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:08.644500 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:08.645120 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:08.645290 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:08.645331 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:08.647611 (+ 2280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:45911: BlockingRecv error: recv got EOF from 127.30.35.195:45911 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 07 20:18:09 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:09 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:09.371177 13612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:09.366819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:34877)
0807 20:18:09.367006 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:09.367020 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:09.367074 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:09.367202 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:09.367202 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:09.367368 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:09.367432 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:09.367434 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:09.368059 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:09.368060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:09.368611 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:09.368613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:09.368908 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:09.368908 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:09.368948 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:09.369364 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:09.369368 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:09.371117 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":93,"threads_started":1}
W20260807 20:18:09.371366 13613 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:09.366912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:34877 (local address 127.30.35.254:43467)
0807 20:18:09.367044 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:09.367046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:09.367056 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:18:09.367129 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:09.367129 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:09.367139 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:09.367183 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:09.367485 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:09.367976 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:09.368675 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:09.368858 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:09.368902 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:09.371267 (+ 2365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:34877: BlockingRecv error: recv got EOF from 127.30.35.193:34877 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":71,"threads_started":1}
Aug 07 20:18:09 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:09 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:09.491734 13615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:09.487238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:56679)
0807 20:18:09.487363 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:09.487373 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:09.487434 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:09.487587 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:09.487587 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:09.487797 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:09.487847 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:09.487850 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:09.488492 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:09.488493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:09.489060 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:09.489062 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:09.489385 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:09.489386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:09.489444 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:09.489963 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:09.489967 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:09.491646 (+ 1679us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":61,"threads_started":1}
W20260807 20:18:09.491796 13613 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:09.487352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:56679 (local address 127.30.35.254:43467)
0807 20:18:09.487431 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:09.487433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:09.487441 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:18:09.487518 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:09.487519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:09.487530 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:09.487574 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:09.487915 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:09.488397 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:09.489138 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:09.489326 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:09.489380 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:09.491743 (+ 2363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:56679: BlockingRecv error: recv got EOF from 127.30.35.194:56679 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 07 20:18:09 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:09 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:09.652562 13617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:09.648082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:41035)
0807 20:18:09.648244 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:09.648256 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:09.648327 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:09.648458 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:09.648459 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:09.648640 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:09.648689 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:09.648691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:09.649333 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:09.649334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:09.649954 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:09.649957 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:09.650275 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:09.650276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:09.650331 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:09.650761 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:09.650766 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:09.652472 (+ 1706us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":96,"threads_started":1}
W20260807 20:18:09.652632 13613 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:09.648163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:41035 (local address 127.30.35.254:43467)
0807 20:18:09.648227 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:09.648229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:09.648317 (+ 88us) server_negotiation.cc:407] Connection header received
0807 20:18:09.648381 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:09.648382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:09.648397 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:09.648445 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:09.648761 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:09.649260 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:09.650029 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:09.650214 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:09.650270 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:09.652577 (+ 2307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:41035: BlockingRecv error: recv got EOF from 127.30.35.195:41035 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 07 20:18:10 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:10 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:10.375792 13618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:10.371582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:53831)
0807 20:18:10.371693 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:10.371702 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:10.371741 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:10.371882 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:10.371882 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:10.372048 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:10.372097 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:10.372099 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:10.372696 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:10.372697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:10.373209 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:10.373211 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:10.373513 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:10.373514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:10.373555 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:10.373963 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:10.373967 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:10.375701 (+ 1734us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":55,"threads_started":1}
W20260807 20:18:10.375857 13623 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:10.371668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:53831 (local address 127.30.35.254:43467)
0807 20:18:10.371778 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:10.371780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:10.371787 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:18:10.371806 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:10.371807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:10.371815 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:10.371872 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:10.372146 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:10.372644 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:10.373257 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:10.373459 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:10.373497 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:10.375797 (+ 2300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:53831: BlockingRecv error: recv got EOF from 127.30.35.193:53831 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":57,"threads_started":1}
Aug 07 20:18:10 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:10 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:10.496476 13625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:10.492192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:54859)
0807 20:18:10.492311 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:10.492321 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:10.492380 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:10.492493 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:10.492493 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:10.492662 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:10.492714 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:10.492716 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:10.493471 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:10.493472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:10.494028 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:10.494029 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:10.494318 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:10.494319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:10.494353 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:10.494768 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:10.494772 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:10.496415 (+ 1643us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":66,"threads_started":1}
W20260807 20:18:10.496570 13623 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:10.492246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:54859 (local address 127.30.35.254:43467)
0807 20:18:10.492303 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:10.492305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:10.492376 (+ 71us) server_negotiation.cc:407] Connection header received
0807 20:18:10.492424 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:10.492424 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:10.492435 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:10.492482 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:10.492762 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:10.493403 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:10.494087 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:10.494270 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:10.494316 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:10.496509 (+ 2193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:54859: BlockingRecv error: recv got EOF from 127.30.35.194:54859 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 07 20:18:10 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:10 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:10.657500 13627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:10.653043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:36759)
0807 20:18:10.653207 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:10.653217 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:10.653279 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:10.653412 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:10.653413 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:10.653612 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:10.653686 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:10.653688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:10.654387 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:10.654388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:10.654903 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:10.654905 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:10.655225 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:10.655226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:10.655279 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:10.655795 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:10.655799 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:10.657421 (+ 1622us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":102,"threads_started":1}
W20260807 20:18:10.657567 13623 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:10.653105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:36759 (local address 127.30.35.254:43467)
0807 20:18:10.653162 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:10.653165 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:10.653269 (+ 104us) server_negotiation.cc:407] Connection header received
0807 20:18:10.653338 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:10.653339 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:10.653351 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:10.653410 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:10.653756 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:10.654308 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:10.654982 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:10.655166 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:10.655219 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:10.657512 (+ 2293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:36759: BlockingRecv error: recv got EOF from 127.30.35.195:36759 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 07 20:18:11 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:11 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:11.380806 13629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:11.376217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:50959)
0807 20:18:11.376337 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:11.376355 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:11.376402 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:11.376514 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:11.376515 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:11.376677 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:11.376729 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:11.376730 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:11.377332 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:11.377332 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:11.377916 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:11.377918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:11.378200 (+ 282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:11.378201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:11.378237 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:11.378693 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:11.378700 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:11.380732 (+ 2032us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":66,"threads_started":1}
W20260807 20:18:11.380904 13630 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:11.376272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:50959 (local address 127.30.35.254:43467)
0807 20:18:11.376390 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:11.376392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:11.376399 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:18:11.376443 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:11.376444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:11.376454 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:11.376504 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:11.376776 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:11.377278 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:11.377972 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:11.378154 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:11.378196 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:11.380828 (+ 2632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:50959: BlockingRecv error: recv got EOF from 127.30.35.193:50959 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":59,"threads_started":1}
Aug 07 20:18:11 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:11 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:11.501399 13631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:11.496928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:49127)
0807 20:18:11.497075 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:11.497087 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:11.497154 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:11.497279 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:11.497280 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:11.497486 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:11.497534 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:11.497536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:11.498235 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:11.498236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:11.498760 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:11.498762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:11.499098 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:11.499099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:11.499156 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:11.499548 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:11.499552 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:11.501300 (+ 1748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":84,"threads_started":1}
W20260807 20:18:11.501458 13630 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:11.497017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:49127 (local address 127.30.35.254:43467)
0807 20:18:11.497079 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:11.497082 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:11.497146 (+ 64us) server_negotiation.cc:407] Connection header received
0807 20:18:11.497207 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:11.497208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:11.497220 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:11.497269 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:11.497612 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:11.498162 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:11.498832 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:11.499039 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:11.499094 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:11.501404 (+ 2310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:49127: BlockingRecv error: recv got EOF from 127.30.35.194:49127 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 07 20:18:11 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:11 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:11.662387 13633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:11.658026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:59111)
0807 20:18:11.658195 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:11.658204 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:11.658261 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:11.658388 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:11.658389 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:11.658555 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:11.658604 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:11.658606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:11.659185 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:11.659186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:11.659686 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:11.659687 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:11.660032 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:11.660034 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:11.660088 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:11.660540 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:11.660544 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:11.662293 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":92,"threads_started":1}
W20260807 20:18:11.662451 13630 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:11.658107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:59111 (local address 127.30.35.254:43467)
0807 20:18:11.658162 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:11.658164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:11.658253 (+ 89us) server_negotiation.cc:407] Connection header received
0807 20:18:11.658306 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:11.658307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:11.658318 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:11.658376 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:11.658652 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:11.659134 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:11.659772 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:11.659964 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:11.660022 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:11.662383 (+ 2361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:59111: BlockingRecv error: recv got EOF from 127.30.35.195:59111 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 07 20:18:12 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:12 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:12.388679 13634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:12.381287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:56141)
0807 20:18:12.381439 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:12.381449 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:12.381497 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:12.381620 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:12.381620 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:12.381803 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:12.381854 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:12.381855 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:12.382535 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:12.382535 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:12.383043 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:12.383044 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:12.383399 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:12.383399 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:12.383440 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:12.386616 (+ 3176us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:12.386621 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:12.388553 (+ 1932us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":73,"threads_started":1}
W20260807 20:18:12.388832 13636 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:12.381369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:56141 (local address 127.30.35.254:43467)
0807 20:18:12.381477 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:12.381479 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:12.381488 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:18:12.381541 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:12.381542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:12.381552 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:12.381610 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:12.381948 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:12.382469 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:12.383133 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:12.383339 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:12.383400 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:12.388706 (+ 5306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:56141: BlockingRecv error: recv got EOF from 127.30.35.193:56141 (error 108)
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":57,"threads_started":1}
Aug 07 20:18:12 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:12 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:12.506505 13637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:12.501926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:34527)
0807 20:18:12.502089 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:12.502100 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:12.502158 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:12.502357 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:12.502358 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:12.502540 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:12.502595 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:12.502597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:12.503208 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:12.503208 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:12.503794 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:12.503796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:12.504090 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:12.504091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:12.504149 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:12.504656 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:12.504661 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:12.506427 (+ 1766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":87,"threads_started":1}
W20260807 20:18:12.506589 13636 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:12.501994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:34527 (local address 127.30.35.254:43467)
0807 20:18:12.502056 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:12.502058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:12.502150 (+ 92us) server_negotiation.cc:407] Connection header received
0807 20:18:12.502205 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:12.502206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:12.502216 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:12.502265 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:12.502661 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:12.503149 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:12.503862 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:12.504038 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:12.504077 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:12.506533 (+ 2456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:34527: BlockingRecv error: recv got EOF from 127.30.35.194:34527 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 07 20:18:12 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:12 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:12.667086 13638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:12.662853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:39701)
0807 20:18:12.663010 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:12.663021 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:12.663071 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:12.663183 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:12.663183 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:12.663357 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:12.663410 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:12.663412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:12.664023 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:12.664024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:12.664548 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:12.664550 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:12.664842 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:12.664843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:12.664886 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:12.665283 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:12.665287 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:12.667021 (+ 1734us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":60,"threads_started":1}
W20260807 20:18:12.667234 13636 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:12.662999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:39701 (local address 127.30.35.254:43467)
0807 20:18:12.663056 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:12.663058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:12.663066 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:18:12.663114 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:12.663115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:12.663125 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:12.663170 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:12.663464 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:12.663952 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:12.664607 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:12.664774 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:12.664815 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:12.667109 (+ 2294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:39701: BlockingRecv error: recv got EOF from 127.30.35.195:39701 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 07 20:18:13 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:13 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:13.393749 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:13.389117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:44519)
0807 20:18:13.389256 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:13.389270 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:13.389359 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:13.389549 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:13.389550 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:13.389845 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:13.389907 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:13.389910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:13.390630 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:13.390631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:13.391180 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:13.391182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:13.391483 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:13.391484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:13.391529 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:13.391937 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:13.391941 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:13.393646 (+ 1705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":70,"threads_started":1}
W20260807 20:18:13.393850 13641 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:13.389171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:44519 (local address 127.30.35.254:43467)
0807 20:18:13.389300 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:13.389302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:13.389338 (+ 36us) server_negotiation.cc:407] Connection header received
0807 20:18:13.389442 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:13.389443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:13.389457 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:13.389530 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:13.390001 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:13.390564 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:13.391245 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:13.391430 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:13.391472 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:13.393777 (+ 2305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:44519: BlockingRecv error: recv got EOF from 127.30.35.193:44519 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":76,"threads_started":1}
Aug 07 20:18:13 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:13 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:13.511615 13643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:13.507025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:49911)
0807 20:18:13.507215 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:13.507226 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:13.507285 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:13.507411 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:13.507412 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:13.507582 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:13.507629 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:13.507630 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:13.508218 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:13.508218 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:13.508776 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:13.508778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:13.509106 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:13.509108 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:13.509170 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:13.509718 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:13.509724 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:13.511522 (+ 1798us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":113,"threads_started":1}
W20260807 20:18:13.511679 13641 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:13.507120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:49911 (local address 127.30.35.254:43467)
0807 20:18:13.507179 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:13.507181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:13.507278 (+ 97us) server_negotiation.cc:407] Connection header received
0807 20:18:13.507346 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:13.507346 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:13.507357 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:13.507404 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:13.507673 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:13.508165 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:13.508833 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:13.509015 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:13.509058 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:13.511612 (+ 2554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:49911: BlockingRecv error: recv got EOF from 127.30.35.194:49911 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 07 20:18:13 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:13 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:13.671636 13644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:13.667501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:52929)
0807 20:18:13.667641 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:13.667652 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:13.667710 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:13.667820 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:13.667821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:13.667987 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:13.668034 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:13.668035 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:13.668614 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:13.668615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:13.669140 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:13.669142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:13.669415 (+ 273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:13.669416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:13.669453 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:13.669860 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:13.669864 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:13.671546 (+ 1682us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":82,"threads_started":1}
W20260807 20:18:13.671700 13641 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:13.667558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:52929 (local address 127.30.35.254:43467)
0807 20:18:13.667626 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:13.667628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:13.667703 (+ 75us) server_negotiation.cc:407] Connection header received
0807 20:18:13.667751 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:13.667752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:13.667763 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:13.667808 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:13.668081 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:13.668563 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:13.669191 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:13.669359 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:13.669401 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:13.671646 (+ 2245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:52929: BlockingRecv error: recv got EOF from 127.30.35.195:52929 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 07 20:18:14 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:14 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:14.399135 13646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:14.394206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:37719)
0807 20:18:14.394336 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:14.394347 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:14.394408 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:14.394538 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:14.394538 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:14.394747 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:14.394808 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:14.394810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:14.395744 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:14.395745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:14.396296 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:14.396298 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:14.396596 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:14.396596 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:14.396633 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:14.397113 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:14.397118 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:14.399063 (+ 1945us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":68,"threads_started":1}
W20260807 20:18:14.399247 13647 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:14.394274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:37719 (local address 127.30.35.254:43467)
0807 20:18:14.394403 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:14.394405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:14.394414 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:18:14.394453 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:14.394454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:14.394465 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:14.394530 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:14.394896 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:14.395670 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:14.396357 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:14.396547 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:14.396591 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:14.399169 (+ 2578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:37719: BlockingRecv error: recv got EOF from 127.30.35.193:37719 (error 108)
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":62,"threads_started":1}
Aug 07 20:18:14 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:14 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:14.516571 13648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:14.512049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:33023)
0807 20:18:14.512217 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:14.512229 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:14.512299 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:14.512432 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:14.512433 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:14.512625 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:14.512675 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:14.512677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:14.513320 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:14.513321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:14.513874 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:14.513877 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:14.514228 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:14.514230 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:14.514310 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:14.514750 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:14.514755 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:14.516505 (+ 1750us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":87,"threads_started":1}
W20260807 20:18:14.516661 13647 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:14.512133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:33023 (local address 127.30.35.254:43467)
0807 20:18:14.512204 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:14.512206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:14.512278 (+ 72us) server_negotiation.cc:407] Connection header received
0807 20:18:14.512352 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:14.512353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:14.512365 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:14.512424 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:14.512751 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:14.513245 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:14.513955 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:14.514148 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:14.514214 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:14.516601 (+ 2387us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:33023: BlockingRecv error: recv got EOF from 127.30.35.194:33023 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 07 20:18:14 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:14 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:14.676765 13649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:14.672212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:44421)
0807 20:18:14.672362 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:14.672373 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:14.672445 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:14.672582 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:14.672583 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:14.672764 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:14.672810 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:14.672812 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:14.673491 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:14.673492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:14.674155 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:14.674158 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:14.674482 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:14.674483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:14.674539 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:14.674967 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:14.674972 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:14.676707 (+ 1735us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":70,"threads_started":1}
W20260807 20:18:14.676892 13647 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:14.672283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:44421 (local address 127.30.35.254:43467)
0807 20:18:14.672343 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:14.672346 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:14.672429 (+ 83us) server_negotiation.cc:407] Connection header received
0807 20:18:14.672503 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:14.672504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:14.672517 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:14.672568 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:14.672912 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:14.673420 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:14.674238 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:14.674424 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:14.674477 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:14.676790 (+ 2313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:44421: BlockingRecv error: recv got EOF from 127.30.35.195:44421 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 07 20:18:15 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:15 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:15.403995 13655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:15.399586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:46355)
0807 20:18:15.399702 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:15.399713 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:15.399762 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:15.399875 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:15.399876 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:15.400054 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:15.400103 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:15.400105 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:15.400707 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:15.400707 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:15.401227 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:15.401229 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:15.401608 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:15.401609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:15.401693 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:15.402166 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:15.402171 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:15.403931 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":68,"threads_started":1}
W20260807 20:18:15.404089 13656 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:15.399657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:46355 (local address 127.30.35.254:43467)
0807 20:18:15.399766 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:15.399768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:15.399776 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:18:15.399798 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:15.399798 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:15.399808 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:15.399867 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:15.400153 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:15.400655 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:15.401281 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:15.401520 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:15.401586 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:15.404017 (+ 2431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:46355: BlockingRecv error: recv got EOF from 127.30.35.193:46355 (error 108)
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":50,"threads_started":1}
Aug 07 20:18:15 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:15 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:15.521641 13658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:15.517154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:57619)
0807 20:18:15.517314 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:15.517325 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:15.517402 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:15.517522 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:15.517522 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:15.517750 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:15.517805 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:15.517807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:15.518427 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:15.518429 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:15.519040 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:15.519043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:15.519399 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:15.519400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:15.519446 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:15.519880 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:15.519884 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:15.521567 (+ 1683us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":71,"threads_started":1}
W20260807 20:18:15.521785 13656 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:15.517286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:57619 (local address 127.30.35.254:43467)
0807 20:18:15.517344 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:15.517346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:15.517386 (+ 40us) server_negotiation.cc:407] Connection header received
0807 20:18:15.517450 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:15.517450 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:15.517460 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:15.517505 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:15.517861 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:15.518358 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:15.519103 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:15.519330 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:15.519380 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:15.521720 (+ 2340us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:57619: BlockingRecv error: recv got EOF from 127.30.35.194:57619 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 07 20:18:15 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:15 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:15.682078 13659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:15.677252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:58989)
0807 20:18:15.677385 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:15.677397 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:15.677464 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:15.677606 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:15.677607 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:15.677810 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:15.677864 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:15.677867 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:15.678560 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:15.678561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:15.679177 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:15.679181 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:15.679618 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:15.679619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:15.679690 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:15.680162 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:15.680167 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:15.681984 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
W20260807 20:18:15.682142 13656 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:15.677349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:58989 (local address 127.30.35.254:43467)
0807 20:18:15.677434 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:15.677436 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:15.677448 (+ 12us) server_negotiation.cc:407] Connection header received
0807 20:18:15.677529 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:15.677530 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:15.677545 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:15.677590 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:15.677954 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:15.678474 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:15.679277 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:15.679532 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:15.679593 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:15.682088 (+ 2495us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:58989: BlockingRecv error: recv got EOF from 127.30.35.195:58989 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 07 20:18:16 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:16 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:16.409001 13660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:16.404503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:59325)
0807 20:18:16.404641 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:16.404653 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:16.404713 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:16.404847 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:16.404848 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:16.405038 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:16.405089 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:16.405091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:16.405758 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:16.405759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:16.406315 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:16.406317 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:16.406612 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:16.406613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:16.406648 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:16.407114 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:16.407118 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:16.408929 (+ 1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
W20260807 20:18:16.409102 13661 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:16.404596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:59325 (local address 127.30.35.254:43467)
0807 20:18:16.404733 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:16.404735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:16.404746 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:18:16.404771 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:16.404771 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:16.404781 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:16.404837 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:16.405161 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:16.405692 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:16.406375 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:16.406563 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:16.406609 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:16.409026 (+ 2417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:59325: BlockingRecv error: recv got EOF from 127.30.35.193:59325 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":70,"threads_started":1}
Aug 07 20:18:16 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:16 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:16.526449 13662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:16.522106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:39301)
0807 20:18:16.522232 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:16.522243 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:16.522298 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:16.522428 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:16.522429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:16.522599 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:16.522647 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:16.522648 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:16.523239 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:16.523240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:16.523760 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:16.523761 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:16.524033 (+ 272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:16.524034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:16.524071 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:16.524515 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:16.524519 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:16.526389 (+ 1870us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":60,"threads_started":1}
W20260807 20:18:16.526546 13661 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:16.522176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:39301 (local address 127.30.35.254:43467)
0807 20:18:16.522226 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:16.522228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:16.522291 (+ 63us) server_negotiation.cc:407] Connection header received
0807 20:18:16.522341 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:16.522348 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:16.522359 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:16.522410 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:16.522694 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:16.523180 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:16.523809 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:16.523987 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:16.524030 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:16.526486 (+ 2456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:39301: BlockingRecv error: recv got EOF from 127.30.35.194:39301 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 07 20:18:16 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:16 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.195@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:16.686993 13665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:16.682543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.195:38249)
0807 20:18:16.682701 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:16.682714 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:16.682780 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:16.682930 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:16.682931 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:16.683102 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:16.683149 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:16.683150 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:16.683794 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:16.683795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:16.684319 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:16.684321 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:16.684722 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:16.684723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:16.684770 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:16.685214 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:16.685218 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:16.686914 (+ 1696us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":99,"threads_started":1}
W20260807 20:18:16.687053 13661 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:16.682636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:38249 (local address 127.30.35.254:43467)
0807 20:18:16.682705 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:16.682707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:16.682772 (+ 65us) server_negotiation.cc:407] Connection header received
0807 20:18:16.682839 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:16.682840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:16.682854 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:16.682897 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:16.683221 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:16.683723 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:16.684398 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:16.684600 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:16.684655 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:16.687000 (+ 2345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.195:38249: BlockingRecv error: recv got EOF from 127.30.35.195:38249 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 07 20:18:17 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:17 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.193@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:17.416640 13667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:17.409523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.193:48459)
0807 20:18:17.409680 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:17.409691 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:17.409744 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:17.409866 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:17.409867 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:17.410043 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:17.410095 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:17.410097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:17.410701 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:17.410701 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:17.411220 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:17.411222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:17.411506 (+ 284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:17.411506 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:17.411541 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:17.414899 (+ 3358us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:17.414904 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:17.416581 (+ 1677us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
W20260807 20:18:17.416750 13669 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:17.409609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:48459 (local address 127.30.35.254:43467)
0807 20:18:17.409738 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:17.409740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:17.409750 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:18:17.409792 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:17.409793 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:17.409804 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:17.409857 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:17.410146 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:17.410647 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:17.411273 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:17.411460 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:17.411501 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:17.416671 (+ 5170us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.193:48459: BlockingRecv error: recv got EOF from 127.30.35.193:48459 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":74,"threads_started":1}
Aug 07 20:18:17 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
Aug 07 20:18:17 dist-test-slave-t7g5 krb5kdc[11977](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.30.35.194@KRBTEST.COM for oryx/127.30.35.254@KRBTEST.COM, Server not found in Kerberos database
I20260807 20:18:17.531378 13670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:17.526937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:43467 (local address 127.30.35.194:52453)
0807 20:18:17.527090 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:17.527102 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:17.527174 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:17.527305 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:17.527306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:17.527498 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:17.527547 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:17.527549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:17.528188 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:17.528189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:17.528717 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:17.528719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:17.529055 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:17.529055 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:17.529111 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:17.529518 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:17.529522 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:17.531299 (+ 1777us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.30.35.254:43467: Server oryx/127.30.35.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
W20260807 20:18:17.531457 13669 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:17.527028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:52453 (local address 127.30.35.254:43467)
0807 20:18:17.527094 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:17.527096 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:17.527160 (+ 64us) server_negotiation.cc:407] Connection header received
0807 20:18:17.527230 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:17.527231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:17.527245 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:17.527293 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:17.527619 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:17.528116 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:17.528789 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:17.528992 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:17.529048 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:17.531405 (+ 2357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.30.35.194:52453: BlockingRecv error: recv got EOF from 127.30.35.194:52453 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 20:18:17.614955 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 12896
I20260807 20:18:17.624229 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 13149
I20260807 20:18:17.634836 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 13359
I20260807 20:18:17.642884 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 12786
2026-08-07T20:18:17Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17596 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T20:18:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:18:17Z Disabled control of system clock
I20260807 20:18:17.678668 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:46451
--webserver_interface=127.30.35.254
--webserver_port=0
--builtin_ntp_servers=127.30.35.212:33691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:46451
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 20:18:17.758116 13681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:17.758313 13681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:17.758332 13681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:17.759493 13681 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:18:17.759534 13681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:17.759545 13681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:17.759557 13681 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:18:17.759581 13681 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:18:17.760910 13681 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:46451
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:46451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:17.761138 13681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:17.761408 13681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:17.766281 13691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:17.766340 13693 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:17.766359 13689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:17.766348 13681 server_base.cc:1034] running on GCE node
I20260807 20:18:17.766726 13681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:17.766978 13681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:17.768114 13681 hybrid_clock.cc:648] HybridClock initialized: now 1786133897768096 us; error 32 us; skew 500 ppm
I20260807 20:18:17.769235 13681 webserver.cc:460] Webserver started at http://127.30.35.254:45151/ using document root <none> and password file <none>
I20260807 20:18:17.769469 13681 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:17.769518 13681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:17.769644 13681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:17.770651 13681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "f6216f120059454cab3c1e1412bda5f6"
format_stamp: "Formatted at 2026-08-07 20:18:17 on dist-test-slave-t7g5"
server_key: "72b965302aa8b04ada876b81ff5d58f9"
server_key_iv: "0085458c86d5eb30fff0eccd63232b8c"
server_key_version: "encryptionkey@0"
I20260807 20:18:17.770982 13681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "f6216f120059454cab3c1e1412bda5f6"
format_stamp: "Formatted at 2026-08-07 20:18:17 on dist-test-slave-t7g5"
server_key: "72b965302aa8b04ada876b81ff5d58f9"
server_key_iv: "0085458c86d5eb30fff0eccd63232b8c"
server_key_version: "encryptionkey@0"
I20260807 20:18:17.772145 13681 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 20:18:17.772806 13701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:17.772948 13681 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:18:17.773030 13681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "f6216f120059454cab3c1e1412bda5f6"
format_stamp: "Formatted at 2026-08-07 20:18:17 on dist-test-slave-t7g5"
server_key: "72b965302aa8b04ada876b81ff5d58f9"
server_key_iv: "0085458c86d5eb30fff0eccd63232b8c"
server_key_version: "encryptionkey@0"
I20260807 20:18:17.773090 13681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:17.787642 13681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:17.787889 13681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:17.788008 13681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:17.791996 13681 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:46451
I20260807 20:18:17.792025 13788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:46451 every 8 connection(s)
I20260807 20:18:17.792328 13681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:18:17.792801 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 13681
I20260807 20:18:17.792896 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:18:17.793051 13789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:18:17.793131 30863 external_mini_cluster.cc:1428] Setting key 58934f1a00829a60f0ad41abd57772d3
I20260807 20:18:17.796423 13789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6: Bootstrap starting.
I20260807 20:18:17.797067 13789 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6: Neither blocks nor log segments found. Creating new log.
I20260807 20:18:17.797365 13789 log.cc:824] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6: Log is configured to *not* fsync() on all Append() calls
I20260807 20:18:17.798164 13789 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6: No bootstrap required, opened a new log
I20260807 20:18:17.798602 13792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:17.793634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49266 (local address 127.30.35.254:46451)
0807 20:18:17.793847 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:17.793856 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:17.793883 (+ 27us) server_negotiation.cc:407] Connection header received
0807 20:18:17.794494 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:17.794500 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:17.794564 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:17.794673 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:17.794904 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:17.795763 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:17.796804 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:17.797228 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:17.797315 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:17.798010 (+ 695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:17.798014 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:17.798014 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:18:17.798170 (+ 156us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:17.798205 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:18:17.798219 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:17.798281 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:17.798364 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 20:18:17.798447 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":84,"threads_started":1}
I20260807 20:18:17.800155 13789 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6216f120059454cab3c1e1412bda5f6" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 46451 } }
I20260807 20:18:17.800288 13789 raft_consensus.cc:374] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:18:17.800311 13789 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6216f120059454cab3c1e1412bda5f6, State: Initialized, Role: FOLLOWER
I20260807 20:18:17.800437 13789 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6216f120059454cab3c1e1412bda5f6" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 46451 } }
I20260807 20:18:17.800523 13789 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:18:17.800557 13789 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:18:17.800606 13789 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:18:17.801112 13789 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6216f120059454cab3c1e1412bda5f6" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 46451 } }
I20260807 20:18:17.801205 13789 leader_election.cc:302] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6216f120059454cab3c1e1412bda5f6; no voters:
I20260807 20:18:17.801355 13789 leader_election.cc:288] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:18:17.801397 13794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:18:17.801550 13794 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [term 1 LEADER]: Becoming Leader. State: Replica: f6216f120059454cab3c1e1412bda5f6, State: Running, Role: LEADER
I20260807 20:18:17.801611 13789 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:18:17.801681 13794 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6216f120059454cab3c1e1412bda5f6" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 46451 } }
I20260807 20:18:17.802085 13795 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6216f120059454cab3c1e1412bda5f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6216f120059454cab3c1e1412bda5f6" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 46451 } } }
I20260807 20:18:17.802093 13796 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6216f120059454cab3c1e1412bda5f6. Latest consensus state: current_term: 1 leader_uuid: "f6216f120059454cab3c1e1412bda5f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6216f120059454cab3c1e1412bda5f6" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 46451 } } }
I20260807 20:18:17.802270 13795 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [sys.catalog]: This master's current role is: LEADER
I20260807 20:18:17.802282 13796 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6 [sys.catalog]: This master's current role is: LEADER
I20260807 20:18:17.802743 13808 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:18:17.803175 13808 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:18:17.804581 13808 catalog_manager.cc:1347] Generated new cluster ID: cc9019c63984419592af741518c8b833
I20260807 20:18:17.804623 13808 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:18:17.816527 13808 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:18:17.817056 13808 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:18:17.823429 13808 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f6216f120059454cab3c1e1412bda5f6: Generated new TSK 0
I20260807 20:18:17.823596 13808 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:18:17.826733 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:46451
--builtin_ntp_servers=127.30.35.212:33691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 20:18:17.909081 13821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:17.909296 13821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:17.909332 13821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:17.910493 13821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:17.910535 13821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:17.910567 13821 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:18:17.911899 13821 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:46451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13821
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:17.912122 13821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:17.912403 13821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:17.917363 13834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:17.917411 13828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:17.917531 13821 server_base.cc:1034] running on GCE node
W20260807 20:18:17.917629 13829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:17.917876 13821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:17.918154 13821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:17.919309 13821 hybrid_clock.cc:648] HybridClock initialized: now 1786133897919296 us; error 32 us; skew 500 ppm
I20260807 20:18:17.920732 13821 webserver.cc:460] Webserver started at http://127.30.35.193:41467/ using document root <none> and password file <none>
I20260807 20:18:17.920979 13821 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:17.921036 13821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:17.921159 13821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:17.922488 13821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "93d854596ae7431aafe17f50600d954a"
format_stamp: "Formatted at 2026-08-07 20:18:17 on dist-test-slave-t7g5"
server_key: "d2abebf2bc7e42d949bbf8f9c68a8849"
server_key_iv: "354a49f4c2e218c67b0ba151caff8cb2"
server_key_version: "encryptionkey@0"
I20260807 20:18:17.922902 13821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "93d854596ae7431aafe17f50600d954a"
format_stamp: "Formatted at 2026-08-07 20:18:17 on dist-test-slave-t7g5"
server_key: "d2abebf2bc7e42d949bbf8f9c68a8849"
server_key_iv: "354a49f4c2e218c67b0ba151caff8cb2"
server_key_version: "encryptionkey@0"
I20260807 20:18:17.924364 13821 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 20:18:17.925012 13846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:17.925172 13821 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:17.925259 13821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "93d854596ae7431aafe17f50600d954a"
format_stamp: "Formatted at 2026-08-07 20:18:17 on dist-test-slave-t7g5"
server_key: "d2abebf2bc7e42d949bbf8f9c68a8849"
server_key_iv: "354a49f4c2e218c67b0ba151caff8cb2"
server_key_version: "encryptionkey@0"
I20260807 20:18:17.925328 13821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:17.947463 13821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:17.947772 13821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:17.947921 13821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:17.948146 13821 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:17.948477 13821 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:17.948511 13821 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:17.948541 13821 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:17.948559 13821 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:17.954166 13821 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:37755
I20260807 20:18:17.954228 14035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:37755 every 8 connection(s)
I20260807 20:18:17.954541 13821 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:18:17.959589 13792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:17.955233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:45549 (local address 127.30.35.254:46451)
0807 20:18:17.955283 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:17.955285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:17.955527 (+ 242us) server_negotiation.cc:407] Connection header received
0807 20:18:17.956073 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:17.956075 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:17.956093 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:17.956151 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:17.956824 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:17.957313 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:17.958292 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:17.958486 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:17.958544 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:17.959314 (+ 770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:17.959316 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:17.959316 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:18:17.959321 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:17.959336 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:18:17.959340 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:17.959388 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:17.959466 (+ 78us) server_negotiation.cc:299] Negotiation successful
0807 20:18:17.959511 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:18:17.959785 14040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:17.955193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:46451 (local address 127.30.35.193:45549)
0807 20:18:17.955380 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:17.955424 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:17.955966 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:17.956237 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:17.956241 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:17.956251 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:17.956731 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:17.956736 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:17.957403 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:17.957404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:17.958203 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:17.958205 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:17.958563 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:17.958564 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:17.958693 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:17.959172 (+ 479us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:18:17.959172 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:17.959200 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:18:17.959223 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:18:17.959394 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:18:17.959400 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:18:17.959403 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:18:17.959464 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 20:18:17.959571 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
I20260807 20:18:17.960242 14038 heartbeater.cc:347] Connected to a master server at 127.30.35.254:46451
I20260807 20:18:17.960323 14038 heartbeater.cc:464] Registering TS with master...
I20260807 20:18:17.960491 14038 heartbeater.cc:511] Master 127.30.35.254:46451 requested a full tablet report, sending...
I20260807 20:18:17.960945 13730 ts_manager.cc:194] Registered new tserver with Master: 93d854596ae7431aafe17f50600d954a (127.30.35.193:37755)
I20260807 20:18:17.961550 13730 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.35.193:45549
I20260807 20:18:17.962332 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 13821
I20260807 20:18:17.962404 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:18:17.962584 30863 external_mini_cluster.cc:1428] Setting key f881c1d8965468f36391d2d3eca0a263
I20260807 20:18:17.963335 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:46451
--builtin_ntp_servers=127.30.35.212:33691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 20:18:18.043742 14041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:18.043939 14041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:18.043959 14041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:18.045074 14041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:18.045115 14041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:18.045140 14041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:18:18.046483 14041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:46451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:18.046705 14041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:18.046980 14041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:18.051685 14055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:18.051671 14052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:18.051702 14053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:18.051831 14041 server_base.cc:1034] running on GCE node
I20260807 20:18:18.052134 14041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:18.052325 14041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:18.053457 14041 hybrid_clock.cc:648] HybridClock initialized: now 1786133898053447 us; error 29 us; skew 500 ppm
I20260807 20:18:18.054714 14041 webserver.cc:460] Webserver started at http://127.30.35.194:38673/ using document root <none> and password file <none>
I20260807 20:18:18.054946 14041 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:18.054991 14041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:18.055111 14041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:18.056128 14041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "81e788e198e64ad985868fa332e93543"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "39b3cf169a138b1e67bb742904bdbea6"
server_key_iv: "1b63fb7bc555955bfccab999524be25c"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.056456 14041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "81e788e198e64ad985868fa332e93543"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "39b3cf169a138b1e67bb742904bdbea6"
server_key_iv: "1b63fb7bc555955bfccab999524be25c"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.057631 14041 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:18:18.058337 14072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.058494 14041 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:18:18.058574 14041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "81e788e198e64ad985868fa332e93543"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "39b3cf169a138b1e67bb742904bdbea6"
server_key_iv: "1b63fb7bc555955bfccab999524be25c"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.058640 14041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:18.068140 14041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:18.068395 14041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:18.068522 14041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:18.068712 14041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:18.069020 14041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:18.069053 14041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.069080 14041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:18.069106 14041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.074918 14041 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:34821
I20260807 20:18:18.074958 14241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:34821 every 8 connection(s)
I20260807 20:18:18.075271 14041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:18:18.078346 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 14041
I20260807 20:18:18.078433 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:18:18.078604 30863 external_mini_cluster.cc:1428] Setting key 1399e53cb039a1344d915e032e97948c
I20260807 20:18:18.079572 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:46451
--builtin_ntp_servers=127.30.35.212:33691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 20:18:18.080436 13792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:18.075972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:37041 (local address 127.30.35.254:46451)
0807 20:18:18.076019 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:18.076021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:18.076271 (+ 250us) server_negotiation.cc:407] Connection header received
0807 20:18:18.076776 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:18.076777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:18.076787 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:18.076835 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:18.077448 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:18.077975 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:18.079015 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:18.079277 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:18.079351 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:18.080202 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:18.080203 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:18.080203 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:18:18.080207 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:18.080223 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:18:18.080227 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:18.080267 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:18.080355 (+ 88us) server_negotiation.cc:299] Negotiation successful
0807 20:18:18.080379 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 20:18:18.080680 14245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:18.075993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:46451 (local address 127.30.35.194:37041)
0807 20:18:18.076172 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:18.076206 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:18.076695 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:18.076891 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:18.076895 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:18.076903 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:18.077389 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:18.077393 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:18.078047 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:18.078048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:18.078940 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:18.078944 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:18.079359 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:18.079360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:18.079539 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:18.080046 (+ 507us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:18:18.080047 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:18.080088 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:18:18.080118 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:18:18.080285 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:18:18.080290 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:18:18.080293 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:18:18.080354 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 20:18:18.080471 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":82,"threads_started":1}
I20260807 20:18:18.081233 14243 heartbeater.cc:347] Connected to a master server at 127.30.35.254:46451
I20260807 20:18:18.081329 14243 heartbeater.cc:464] Registering TS with master...
I20260807 20:18:18.081506 14243 heartbeater.cc:511] Master 127.30.35.254:46451 requested a full tablet report, sending...
I20260807 20:18:18.081876 13730 ts_manager.cc:194] Registered new tserver with Master: 81e788e198e64ad985868fa332e93543 (127.30.35.194:34821)
I20260807 20:18:18.082331 13730 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.35.194:37041
W20260807 20:18:18.161795 14247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:18.162019 14247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:18.162051 14247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:18.163183 14247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:18.163218 14247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:18.163249 14247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:18:18.164532 14247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:46451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:18.164757 14247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:18.165010 14247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:18.169734 14252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:18.169862 14247 server_base.cc:1034] running on GCE node
W20260807 20:18:18.169734 14256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:18.169950 14253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:18.170198 14247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:18.170423 14247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:18.171559 14247 hybrid_clock.cc:648] HybridClock initialized: now 1786133898171551 us; error 34 us; skew 500 ppm
I20260807 20:18:18.172672 14247 webserver.cc:460] Webserver started at http://127.30.35.195:42173/ using document root <none> and password file <none>
I20260807 20:18:18.172902 14247 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:18.172951 14247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:18.173079 14247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:18.174140 14247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "30e03c936f8e49e9b9ebb55d41d2cf46"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "8b916d0615005c7dbda6f63544be125d"
server_key_iv: "880aa22c9bec1491267156c7bda8ecbe"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.174471 14247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "30e03c936f8e49e9b9ebb55d41d2cf46"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "8b916d0615005c7dbda6f63544be125d"
server_key_iv: "880aa22c9bec1491267156c7bda8ecbe"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.175845 14247 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:18:18.176494 14268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.176630 14247 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:18:18.176712 14247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "30e03c936f8e49e9b9ebb55d41d2cf46"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "8b916d0615005c7dbda6f63544be125d"
server_key_iv: "880aa22c9bec1491267156c7bda8ecbe"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.176780 14247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:18.193394 14247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:18.193779 14247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:18.193924 14247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:18.194159 14247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:18.194535 14247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:18.194571 14247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.194608 14247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:18.194636 14247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.200438 14247 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:40571
I20260807 20:18:18.200490 14426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:40571 every 8 connection(s)
I20260807 20:18:18.200789 14247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:18:18.205319 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 14247
I20260807 20:18:18.205403 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:18:18.205619 30863 external_mini_cluster.cc:1428] Setting key a1bb472c3f2a7657978cdc1f6e943877
I20260807 20:18:18.205751 13792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:18.201471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:56489 (local address 127.30.35.254:46451)
0807 20:18:18.201557 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:18.201559 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:18.201794 (+ 235us) server_negotiation.cc:407] Connection header received
0807 20:18:18.202288 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:18.202289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:18.202301 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:18.202349 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:18.203025 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:18.203511 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:18.204461 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:18.204629 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:18.204672 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:18.205440 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:18.205442 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:18.205442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:18:18.205448 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:18.205466 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:18:18.205471 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:18.205531 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:18.205591 (+ 60us) server_negotiation.cc:299] Negotiation successful
0807 20:18:18.205616 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 20:18:18.205987 14429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:18.201457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:46451 (local address 127.30.35.195:56489)
0807 20:18:18.201676 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:18.201716 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:18.202191 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:18.202437 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:18.202440 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:18.202449 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:18.202952 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:18.202957 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:18.203577 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:18.203578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:18.204401 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:18.204404 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:18.204680 (+ 276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:18.204680 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:18.204784 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:18.205297 (+ 513us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:18:18.205297 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:18.205326 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:18:18.205351 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:18:18.205534 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:18:18.205539 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:18:18.205541 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 20:18:18.205591 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 20:18:18.205702 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":84,"threads_started":1}
I20260807 20:18:18.206596 14427 heartbeater.cc:347] Connected to a master server at 127.30.35.254:46451
I20260807 20:18:18.206681 14427 heartbeater.cc:464] Registering TS with master...
I20260807 20:18:18.206827 14427 heartbeater.cc:511] Master 127.30.35.254:46451 requested a full tablet report, sending...
I20260807 20:18:18.207134 13729 ts_manager.cc:194] Registered new tserver with Master: 30e03c936f8e49e9b9ebb55d41d2cf46 (127.30.35.195:40571)
I20260807 20:18:18.207484 13729 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.35.195:56489
I20260807 20:18:18.217443 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 20:18:18.219215 13792 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:18.218738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49282 (local address 127.30.35.254:46451)
0807 20:18:18.218816 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:18.218818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:18.218926 (+ 108us) server_negotiation.cc:407] Connection header received
0807 20:18:18.218973 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:18.218974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:18.218984 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:18.219028 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:18.219149 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49282: BlockingRecv error: recv got EOF from 127.0.0.1:49282 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260807 20:18:18.219240 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 13821
I20260807 20:18:18.235677 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 14041
I20260807 20:18:18.243507 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 14247
I20260807 20:18:18.254196 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 13681
2026-08-07T20:18:18Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (606 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T20:18:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:18:18Z Disabled control of system clock
I20260807 20:18:18.284739 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:40767
--webserver_interface=127.30.35.254
--webserver_port=0
--builtin_ntp_servers=127.30.35.212:36749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:40767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 20:18:18.363569 14443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:18.363771 14443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:18.363790 14443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:18.364903 14443 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:18:18.364943 14443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:18.364954 14443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:18.364976 14443 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:18:18.364998 14443 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:18:18.366346 14443 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:40767
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:40767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:18.366578 14443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:18.366843 14443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:18.371214 14456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:18.371265 14454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:18.371269 14453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:18.371533 14443 server_base.cc:1034] running on GCE node
I20260807 20:18:18.371762 14443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:18.372020 14443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:18.373163 14443 hybrid_clock.cc:648] HybridClock initialized: now 1786133898373136 us; error 38 us; skew 500 ppm
I20260807 20:18:18.374321 14443 webserver.cc:460] Webserver started at http://127.30.35.254:40615/ using document root <none> and password file <none>
I20260807 20:18:18.374534 14443 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:18.374583 14443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:18.374708 14443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:18.375702 14443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "2729a6a939b34b608b175591aa157e73"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "c6920a2b796c254454cebc9f7df9370a"
server_key_iv: "2ae06cdf4998d0a728f19ab765270ee7"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.376039 14443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "2729a6a939b34b608b175591aa157e73"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "c6920a2b796c254454cebc9f7df9370a"
server_key_iv: "2ae06cdf4998d0a728f19ab765270ee7"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.377277 14443 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:18:18.378013 14466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.378165 14443 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.378262 14443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "2729a6a939b34b608b175591aa157e73"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "c6920a2b796c254454cebc9f7df9370a"
server_key_iv: "2ae06cdf4998d0a728f19ab765270ee7"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.378326 14443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:18.381467 14443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:18.381745 14443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:18.381870 14443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:18.385421 14443 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:40767
I20260807 20:18:18.385454 14547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:40767 every 8 connection(s)
I20260807 20:18:18.385795 14443 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:18:18.386401 14549 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:18:18.388518 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 14443
I20260807 20:18:18.388617 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:18:18.388818 30863 external_mini_cluster.cc:1428] Setting key ecb8200153460f6e7ee496b557d31d20
I20260807 20:18:18.389170 14549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73: Bootstrap starting.
I20260807 20:18:18.389825 14549 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73: Neither blocks nor log segments found. Creating new log.
I20260807 20:18:18.390152 14549 log.cc:824] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73: Log is configured to *not* fsync() on all Append() calls
I20260807 20:18:18.390841 14549 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73: No bootstrap required, opened a new log
I20260807 20:18:18.391445 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:18.389324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44418 (local address 127.30.35.254:40767)
0807 20:18:18.389550 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:18.389558 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:18.389590 (+ 32us) server_negotiation.cc:407] Connection header received
0807 20:18:18.390152 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:18.390160 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:18.390213 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:18.390370 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:18.391000 (+ 630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:18.391004 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:18.391004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:18:18.391008 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:18.391054 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:18:18.391064 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:18.391126 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:18.391212 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 20:18:18.391260 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":101,"threads_started":1}
I20260807 20:18:18.392654 14549 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2729a6a939b34b608b175591aa157e73" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40767 } }
I20260807 20:18:18.392779 14549 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:18:18.392812 14549 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2729a6a939b34b608b175591aa157e73, State: Initialized, Role: FOLLOWER
I20260807 20:18:18.392931 14549 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2729a6a939b34b608b175591aa157e73" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40767 } }
I20260807 20:18:18.393002 14549 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:18:18.393031 14549 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:18:18.393077 14549 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:18:18.393637 14549 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2729a6a939b34b608b175591aa157e73" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40767 } }
I20260807 20:18:18.393769 14549 leader_election.cc:302] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2729a6a939b34b608b175591aa157e73; no voters:
I20260807 20:18:18.393924 14549 leader_election.cc:288] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:18:18.393965 14556 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:18:18.394105 14556 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [term 1 LEADER]: Becoming Leader. State: Replica: 2729a6a939b34b608b175591aa157e73, State: Running, Role: LEADER
I20260807 20:18:18.394169 14549 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:18:18.394192 14556 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2729a6a939b34b608b175591aa157e73" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40767 } }
I20260807 20:18:18.394537 14560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2729a6a939b34b608b175591aa157e73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2729a6a939b34b608b175591aa157e73" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40767 } } }
I20260807 20:18:18.394546 14561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2729a6a939b34b608b175591aa157e73. Latest consensus state: current_term: 1 leader_uuid: "2729a6a939b34b608b175591aa157e73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2729a6a939b34b608b175591aa157e73" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40767 } } }
I20260807 20:18:18.394665 14560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [sys.catalog]: This master's current role is: LEADER
I20260807 20:18:18.394671 14561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73 [sys.catalog]: This master's current role is: LEADER
I20260807 20:18:18.394882 14572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:18:18.395318 14572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:18:18.398567 14572 catalog_manager.cc:1347] Generated new cluster ID: ba7f32c187c54921bcaeed25f0f9d70d
I20260807 20:18:18.398613 14572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:18:18.406744 14572 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:18:18.406895 14572 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:18:18.414215 14572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2729a6a939b34b608b175591aa157e73: Generated new TSK 0
I20260807 20:18:18.414384 14572 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:18:18.422181 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40767
--builtin_ntp_servers=127.30.35.212:36749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 20:18:18.503223 14592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:18.503460 14592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:18.503496 14592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:18.504964 14592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:18.505005 14592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:18.505048 14592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:18:18.506417 14592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:18.506640 14592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:18.506899 14592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:18.511616 14598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:18.511638 14607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:18.511665 14599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:18.512383 14592 server_base.cc:1034] running on GCE node
I20260807 20:18:18.512576 14592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:18.512786 14592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:18.513926 14592 hybrid_clock.cc:648] HybridClock initialized: now 1786133898513910 us; error 29 us; skew 500 ppm
I20260807 20:18:18.515120 14592 webserver.cc:460] Webserver started at http://127.30.35.193:36971/ using document root <none> and password file <none>
I20260807 20:18:18.515326 14592 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:18.515372 14592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:18.515512 14592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:18.516511 14592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "0c931cb7dc9a4f7fb3b3e4d2555cb3bd"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "07946a1629b884f10e3eb918d57a3a38"
server_key_iv: "50e6952ecd931a65b902158d65aca735"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.516840 14592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "0c931cb7dc9a4f7fb3b3e4d2555cb3bd"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "07946a1629b884f10e3eb918d57a3a38"
server_key_iv: "50e6952ecd931a65b902158d65aca735"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.518153 14592 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:18:18.518879 14616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.519025 14592 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:18:18.519112 14592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "0c931cb7dc9a4f7fb3b3e4d2555cb3bd"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "07946a1629b884f10e3eb918d57a3a38"
server_key_iv: "50e6952ecd931a65b902158d65aca735"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.519171 14592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:18.522405 14592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:18.522645 14592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:18.522763 14592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:18.522958 14592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:18.523245 14592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:18.523277 14592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.523303 14592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:18.523329 14592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.528513 14592 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:43419
I20260807 20:18:18.528576 14792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:43419 every 8 connection(s)
I20260807 20:18:18.528849 14592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:18:18.531510 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:18.529502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:58187 (local address 127.30.35.254:40767)
0807 20:18:18.529551 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:18.529553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:18.529801 (+ 248us) server_negotiation.cc:407] Connection header received
0807 20:18:18.530268 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:18.530269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:18.530274 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:18.530311 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:18.531330 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:18.531331 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:18.531331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:18:18.531335 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:18.531353 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:18:18.531357 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:18.531398 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:18.531446 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 20:18:18.531457 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 20:18:18.531679 14796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:18.529485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40767 (local address 127.30.35.193:58187)
0807 20:18:18.529692 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:18.529732 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:18.530170 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:18.530370 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:18.530374 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:18.530382 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:18.531199 (+ 817us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:18:18.531199 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:18.531227 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:18:18.531254 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:18:18.531398 (+ 144us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:18:18.531400 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:18:18.531403 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:18:18.531447 (+ 44us) client_negotiation.cc:240] Negotiation successful
0807 20:18:18.531494 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":66,"threads_started":1}
I20260807 20:18:18.532205 14793 heartbeater.cc:347] Connected to a master server at 127.30.35.254:40767
I20260807 20:18:18.532296 14793 heartbeater.cc:464] Registering TS with master...
I20260807 20:18:18.532444 14793 heartbeater.cc:511] Master 127.30.35.254:40767 requested a full tablet report, sending...
I20260807 20:18:18.532907 14489 ts_manager.cc:194] Registered new tserver with Master: 0c931cb7dc9a4f7fb3b3e4d2555cb3bd (127.30.35.193:43419)
I20260807 20:18:18.537590 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 14592
I20260807 20:18:18.537691 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:18:18.537878 30863 external_mini_cluster.cc:1428] Setting key 2dbe403c0392aedb24149332ff501012
I20260807 20:18:18.538690 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40767
--builtin_ntp_servers=127.30.35.212:36749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 20:18:18.618916 14797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:18.619122 14797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:18.619143 14797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:18.620275 14797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:18.620317 14797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:18.620342 14797 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:18:18.621706 14797 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:18.621927 14797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:18.622205 14797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:18.626932 14809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:18.627012 14797 server_base.cc:1034] running on GCE node
W20260807 20:18:18.626932 14806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:18.626974 14807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:18.627373 14797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:18.627635 14797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:18.628793 14797 hybrid_clock.cc:648] HybridClock initialized: now 1786133898628775 us; error 30 us; skew 500 ppm
I20260807 20:18:18.630157 14797 webserver.cc:460] Webserver started at http://127.30.35.194:43785/ using document root <none> and password file <none>
I20260807 20:18:18.630398 14797 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:18.630452 14797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:18.630594 14797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:18.631675 14797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "9cc08ff96ed04bf881a1c8be79639c00"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "bb85947b939a1279ab2659c7a0669bd6"
server_key_iv: "298f6e6fd62ce419c40ee3fa91542644"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.632031 14797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "9cc08ff96ed04bf881a1c8be79639c00"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "bb85947b939a1279ab2659c7a0669bd6"
server_key_iv: "298f6e6fd62ce419c40ee3fa91542644"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.633507 14797 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:18:18.634245 14821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.634400 14797 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.634488 14797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "9cc08ff96ed04bf881a1c8be79639c00"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "bb85947b939a1279ab2659c7a0669bd6"
server_key_iv: "298f6e6fd62ce419c40ee3fa91542644"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.634560 14797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:18.637847 14797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:18.638090 14797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:18.638230 14797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:18.638422 14797 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:18.638716 14797 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:18.638754 14797 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.638783 14797 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:18.638810 14797 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.644726 14797 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:35349
I20260807 20:18:18.644778 14977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:35349 every 8 connection(s)
I20260807 20:18:18.645058 14797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:18:18.647632 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:18.645691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:41439 (local address 127.30.35.254:40767)
0807 20:18:18.645742 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:18.645744 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:18.645948 (+ 204us) server_negotiation.cc:407] Connection header received
0807 20:18:18.646366 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:18.646367 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:18.646372 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:18.646413 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:18.647438 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:18.647440 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:18.647440 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:18:18.647445 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:18.647461 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:18:18.647466 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:18.647518 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:18.647564 (+ 46us) server_negotiation.cc:299] Negotiation successful
0807 20:18:18.647577 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:18:18.647789 14982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:18.645629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40767 (local address 127.30.35.194:41439)
0807 20:18:18.645828 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:18.645864 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:18.646273 (+ 409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:18.646469 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:18.646473 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:18.646480 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:18.647304 (+ 824us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:18:18.647305 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:18.647331 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:18:18.647356 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:18:18.647519 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:18:18.647522 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:18:18.647524 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 20:18:18.647570 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 20:18:18.647615 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":106,"threads_started":1}
I20260807 20:18:18.648242 14978 heartbeater.cc:347] Connected to a master server at 127.30.35.254:40767
I20260807 20:18:18.648324 14978 heartbeater.cc:464] Registering TS with master...
I20260807 20:18:18.648458 14978 heartbeater.cc:511] Master 127.30.35.254:40767 requested a full tablet report, sending...
I20260807 20:18:18.648768 14489 ts_manager.cc:194] Registered new tserver with Master: 9cc08ff96ed04bf881a1c8be79639c00 (127.30.35.194:35349)
I20260807 20:18:18.653862 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 14797
I20260807 20:18:18.653950 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:18:18.654134 30863 external_mini_cluster.cc:1428] Setting key 91afbe51b9b03853810c73ed8a4cb1fc
I20260807 20:18:18.654987 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40767
--builtin_ntp_servers=127.30.35.212:36749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 20:18:18.734879 14983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:18.735072 14983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:18.735103 14983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:18.736239 14983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:18.736279 14983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:18.736310 14983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:18:18.737632 14983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:36749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:40767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:18.737883 14983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:18.738168 14983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:18.742820 14996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:18.742831 14993 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:18.742897 14994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:18.743216 14983 server_base.cc:1034] running on GCE node
I20260807 20:18:18.743405 14983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:18.743598 14983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:18.744720 14983 hybrid_clock.cc:648] HybridClock initialized: now 1786133898744711 us; error 26 us; skew 500 ppm
I20260807 20:18:18.745937 14983 webserver.cc:460] Webserver started at http://127.30.35.195:38807/ using document root <none> and password file <none>
I20260807 20:18:18.746163 14983 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:18.746207 14983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:18.746336 14983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:18.747381 14983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "7a194d49af104572bf66f63842333036"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "57540d7981324c166cc977d41559dc4f"
server_key_iv: "98404196806ae52c0cae1f696ceea2e9"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.747709 14983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "7a194d49af104572bf66f63842333036"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "57540d7981324c166cc977d41559dc4f"
server_key_iv: "98404196806ae52c0cae1f696ceea2e9"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.748895 14983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:18:18.749554 15004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.749719 14983 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:18:18.749799 14983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "7a194d49af104572bf66f63842333036"
format_stamp: "Formatted at 2026-08-07 20:18:18 on dist-test-slave-t7g5"
server_key: "57540d7981324c166cc977d41559dc4f"
server_key_iv: "98404196806ae52c0cae1f696ceea2e9"
server_key_version: "encryptionkey@0"
I20260807 20:18:18.749868 14983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:18.753044 14983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:18.753274 14983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:18.753383 14983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:18.753566 14983 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:18.753866 14983 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:18.753898 14983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.753935 14983 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:18.753958 14983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:18.759146 14983 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:34097
I20260807 20:18:18.759207 15168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:34097 every 8 connection(s)
I20260807 20:18:18.759464 14983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:18:18.759882 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 14983
I20260807 20:18:18.759977 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:18:18.760188 30863 external_mini_cluster.cc:1428] Setting key 7d7e2753ab18663c46e35dfe3f73f665
I20260807 20:18:18.762369 14552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:18.760134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:58879 (local address 127.30.35.254:40767)
0807 20:18:18.760180 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:18.760182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:18.760494 (+ 312us) server_negotiation.cc:407] Connection header received
0807 20:18:18.761062 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:18.761064 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:18.761070 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:18.761123 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:18.762188 (+ 1065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:18.762189 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:18.762189 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:18:18.762193 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:18.762208 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:18:18.762212 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:18.762254 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:18.762300 (+ 46us) server_negotiation.cc:299] Negotiation successful
0807 20:18:18.762312 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:18:18.762542 15171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:18.760141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40767 (local address 127.30.35.195:58879)
0807 20:18:18.760354 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:18.760398 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:18.760961 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:18.761193 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:18.761197 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:18.761204 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:18.762058 (+ 854us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:18:18.762058 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:18.762087 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:18:18.762116 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:18:18.762255 (+ 139us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:18:18.762257 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:18:18.762259 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 20:18:18.762306 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 20:18:18.762351 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":91,"threads_started":1}
I20260807 20:18:18.762974 15169 heartbeater.cc:347] Connected to a master server at 127.30.35.254:40767
I20260807 20:18:18.763053 15169 heartbeater.cc:464] Registering TS with master...
I20260807 20:18:18.763186 15169 heartbeater.cc:511] Master 127.30.35.254:40767 requested a full tablet report, sending...
I20260807 20:18:18.763520 14489 ts_manager.cc:194] Registered new tserver with Master: 7a194d49af104572bf66f63842333036 (127.30.35.195:34097)
I20260807 20:18:18.771694 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 20:18:18.773291 14552 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:18:18.772920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44434 (local address 127.30.35.254:40767)
0807 20:18:18.772970 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:18.772971 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:18.773059 (+ 88us) server_negotiation.cc:407] Connection header received
0807 20:18:18.773099 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:18.773099 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:18.773103 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:18.773142 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:18.773243 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44434: BlockingRecv error: recv got EOF from 127.0.0.1:44434 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 20:18:18.773378 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 14592
I20260807 20:18:18.783737 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 14797
I20260807 20:18:18.801976 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 14983
I20260807 20:18:18.808583 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 14443
2026-08-07T20:18:18Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (555 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:18:18 dist-test-slave-t7g5 krb5kdc[15183](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:18:18 dist-test-slave-t7g5 krb5kdc[15183](info): set up 2 sockets
Aug 07 20:18:18 dist-test-slave-t7g5 krb5kdc[15183](info): commencing operation
krb5kdc: starting...
W20260807 20:18:19.958027 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:18:20 dist-test-slave-t7g5 krb5kdc[15183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133900, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:18:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:18:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:18:20.075726 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:35115
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:43871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:35115
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:18:20.158236 15200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:20.158438 15200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:20.158459 15200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:20.159524 15200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:18:20.159559 15200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:20.159571 15200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:20.159582 15200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:18:20.159596 15200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:18:20.161026 15200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:43871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:35115
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:35115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:20.161218 15200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:20.161386 15200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:20.165930 15210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:20.165993 15212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:20.166059 15200 server_base.cc:1034] running on GCE node
W20260807 20:18:20.165930 15209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:20.166411 15200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:20.166677 15200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:20.167829 15200 hybrid_clock.cc:648] HybridClock initialized: now 1786133900167817 us; error 35 us; skew 500 ppm
Aug 07 20:18:20 dist-test-slave-t7g5 krb5kdc[15183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133900, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:18:20.172600 15200 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:18:20.173060 15200 webserver.cc:460] Webserver started at http://127.30.35.254:40479/ using document root <none> and password file <none>
I20260807 20:18:20.173264 15200 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:20.173310 15200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:20.173444 15200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:20.174544 15200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "801cd888df53490bbad0c237d1124aac"
format_stamp: "Formatted at 2026-08-07 20:18:20 on dist-test-slave-t7g5"
server_key: "3ef2f22fe097566a98ab98a6ad72abca"
server_key_iv: "9d00b46899809870e748a3bd1482cab0"
server_key_version: "encryptionkey@0"
I20260807 20:18:20.174891 15200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "801cd888df53490bbad0c237d1124aac"
format_stamp: "Formatted at 2026-08-07 20:18:20 on dist-test-slave-t7g5"
server_key: "3ef2f22fe097566a98ab98a6ad72abca"
server_key_iv: "9d00b46899809870e748a3bd1482cab0"
server_key_version: "encryptionkey@0"
I20260807 20:18:20.176156 15200 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:18:20.176827 15221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:20.176976 15200 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:18:20.177062 15200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "801cd888df53490bbad0c237d1124aac"
format_stamp: "Formatted at 2026-08-07 20:18:20 on dist-test-slave-t7g5"
server_key: "3ef2f22fe097566a98ab98a6ad72abca"
server_key_iv: "9d00b46899809870e748a3bd1482cab0"
server_key_version: "encryptionkey@0"
I20260807 20:18:20.177130 15200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:20.195613 15200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:20.198057 15200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:20.198199 15200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:20.202090 15200 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:35115
I20260807 20:18:20.202126 15299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:35115 every 8 connection(s)
I20260807 20:18:20.202468 15200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:18:20.203377 15300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:18:20.205597 15300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac: Bootstrap starting.
I20260807 20:18:20.206202 15300 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac: Neither blocks nor log segments found. Creating new log.
I20260807 20:18:20.206424 15300 log.cc:824] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac: Log is configured to *not* fsync() on all Append() calls
I20260807 20:18:20.207078 15300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac: No bootstrap required, opened a new log
I20260807 20:18:20.208566 15300 raft_consensus.cc:348] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "801cd888df53490bbad0c237d1124aac" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 35115 } }
I20260807 20:18:20.208703 15300 raft_consensus.cc:374] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:18:20.208731 15300 raft_consensus.cc:729] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 801cd888df53490bbad0c237d1124aac, State: Initialized, Role: FOLLOWER
I20260807 20:18:20.208835 15300 consensus_queue.cc:260] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "801cd888df53490bbad0c237d1124aac" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 35115 } }
I20260807 20:18:20.208886 15300 raft_consensus.cc:388] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:18:20.208914 15300 raft_consensus.cc:482] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:18:20.208961 15300 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:18:20.209736 15300 raft_consensus.cc:504] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "801cd888df53490bbad0c237d1124aac" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 35115 } }
I20260807 20:18:20.209832 15300 leader_election.cc:302] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 801cd888df53490bbad0c237d1124aac; no voters:
I20260807 20:18:20.209988 15300 leader_election.cc:288] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:18:20.210031 15303 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:18:20.210177 15303 raft_consensus.cc:686] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [term 1 LEADER]: Becoming Leader. State: Replica: 801cd888df53490bbad0c237d1124aac, State: Running, Role: LEADER
I20260807 20:18:20.210222 15300 sys_catalog.cc:564] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:18:20.210264 15303 consensus_queue.cc:237] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "801cd888df53490bbad0c237d1124aac" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 35115 } }
I20260807 20:18:20.210608 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 15200
I20260807 20:18:20.210718 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:18:20.210940 30863 external_mini_cluster.cc:1428] Setting key 14d8d805cabd7c40b281b28c875881e0
I20260807 20:18:20.211690 15306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 801cd888df53490bbad0c237d1124aac. Latest consensus state: current_term: 1 leader_uuid: "801cd888df53490bbad0c237d1124aac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "801cd888df53490bbad0c237d1124aac" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 35115 } } }
I20260807 20:18:20.211949 15306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [sys.catalog]: This master's current role is: LEADER
I20260807 20:18:20.211889 15304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "801cd888df53490bbad0c237d1124aac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "801cd888df53490bbad0c237d1124aac" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 35115 } } }
W20260807 20:18:20.212164 15329 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:18:20.212316 15329 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:18:20.212188 15304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac [sys.catalog]: This master's current role is: LEADER
I20260807 20:18:20.212496 15333 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:18:20.212695 15333 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:18:20.214067 15333 catalog_manager.cc:1347] Generated new cluster ID: cbd79608d07547d2ad21d0745f68134b
I20260807 20:18:20.214115 15333 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:18:20 dist-test-slave-t7g5 krb5kdc[15183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133900, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:18:20.222868 15325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.211419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55530 (local address 127.30.35.254:35115)
0807 20:18:20.211580 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:20.211590 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:20.211934 (+ 344us) server_negotiation.cc:407] Connection header received
0807 20:18:20.212061 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:20.212069 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:20.212130 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:20.212267 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:20.213015 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.214383 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.215378 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.216019 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.216126 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.219371 (+ 3245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:20.219375 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:20.219376 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:18:20.219389 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:20.221252 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:20.221617 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:20.221620 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:20.221620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:20.221754 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:20.221955 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:20.221956 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:20.221956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:20.222259 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:20.222422 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:20.222492 (+ 70us) server_negotiation.cc:299] Negotiation successful
0807 20:18:20.222629 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":90,"threads_started":1}
I20260807 20:18:20.228497 15333 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:18:20.229001 15333 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:18:20.241127 15333 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac: Generated new TSK 0
I20260807 20:18:20.241328 15333 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:18:20.274149 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:35115
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:43871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:18:20.377948 15342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:20.378270 15342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:20.378321 15342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:20.379923 15342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:20.379987 15342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:20.380025 15342 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:18:20.382112 15342 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:43871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:35115
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:20.382382 15342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:20.382638 15342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:20.389451 15348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:20.389444 15347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:20.389757 15350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:20.390177 15342 server_base.cc:1034] running on GCE node
I20260807 20:18:20.390372 15342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:20.390606 15342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:20.391762 15342 hybrid_clock.cc:648] HybridClock initialized: now 1786133900391739 us; error 38 us; skew 500 ppm
Aug 07 20:18:20 dist-test-slave-t7g5 krb5kdc[15183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133900, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:18:20.394470 15342 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:18:20.395012 15342 webserver.cc:460] Webserver started at http://127.30.35.193:44515/ using document root <none> and password file <none>
I20260807 20:18:20.395305 15342 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:20.395368 15342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:20.395538 15342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:20.396981 15342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "00b3bd8d996a4257be24e1d6e82b3305"
format_stamp: "Formatted at 2026-08-07 20:18:20 on dist-test-slave-t7g5"
server_key: "aaeb35c9042899ff69b42f7fbea6af9f"
server_key_iv: "bacc81cd4da15e7deaccdb9bb596bb0a"
server_key_version: "encryptionkey@0"
I20260807 20:18:20.397420 15342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "00b3bd8d996a4257be24e1d6e82b3305"
format_stamp: "Formatted at 2026-08-07 20:18:20 on dist-test-slave-t7g5"
server_key: "aaeb35c9042899ff69b42f7fbea6af9f"
server_key_iv: "bacc81cd4da15e7deaccdb9bb596bb0a"
server_key_version: "encryptionkey@0"
I20260807 20:18:20.399185 15342 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 20:18:20.400079 15358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:20.400247 15342 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:18:20.400323 15342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "00b3bd8d996a4257be24e1d6e82b3305"
format_stamp: "Formatted at 2026-08-07 20:18:20 on dist-test-slave-t7g5"
server_key: "aaeb35c9042899ff69b42f7fbea6af9f"
server_key_iv: "bacc81cd4da15e7deaccdb9bb596bb0a"
server_key_version: "encryptionkey@0"
I20260807 20:18:20.400391 15342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:20.408351 15342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:20.410447 15342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:20.410578 15342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:20.410777 15342 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:20.411053 15342 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:20.411084 15342 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:20.411110 15342 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:20.411125 15342 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:20.416695 15342 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:42171
I20260807 20:18:20.416750 15521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:42171 every 8 connection(s)
I20260807 20:18:20.417033 15342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:18:20.419974 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 15342
I20260807 20:18:20.420078 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:18:20.420291 30863 external_mini_cluster.cc:1428] Setting key 80c11fe32e02b3d5439e0555948c85b5
Aug 07 20:18:20 dist-test-slave-t7g5 krb5kdc[15183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133900, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:18:20.426515 15325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.417756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:51927 (local address 127.30.35.254:35115)
0807 20:18:20.417820 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:20.417823 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:20.417973 (+ 150us) server_negotiation.cc:407] Connection header received
0807 20:18:20.418431 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:20.418432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:20.418446 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:20.418497 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:20.419366 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.419912 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.421209 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.421416 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.421469 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.423889 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:20.423890 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:20.423890 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:18:20.423898 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:20.425094 (+ 1196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:20.425577 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:20.425578 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:20.425578 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:20.425628 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:20.425901 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:20.425902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:20.425902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:20.426002 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:20.426049 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:20.426379 (+ 330us) server_negotiation.cc:299] Negotiation successful
0807 20:18:20.426454 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 20:18:20.426756 15529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.417708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:35115 (local address 127.30.35.193:51927)
0807 20:18:20.417862 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:20.417899 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:20.418345 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:20.418553 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:20.418556 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:20.419097 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:20.419284 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.419288 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.420001 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.420003 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.421129 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.421133 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.421492 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.421493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.421632 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.422168 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:20.422178 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:20.423800 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:18:20.425188 (+ 1388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:18:20.425196 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:18:20.425199 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:18:20.425505 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:18:20.425698 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:18:20.425698 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:18:20.425699 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:18:20.425842 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:18:20.426061 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:18:20.426068 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:18:20.426234 (+ 166us) client_negotiation.cc:769] Sending connection context
0807 20:18:20.426364 (+ 130us) client_negotiation.cc:240] Negotiation successful
0807 20:18:20.426532 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":84,"threads_started":1}
I20260807 20:18:20.427248 15526 heartbeater.cc:347] Connected to a master server at 127.30.35.254:35115
I20260807 20:18:20.427354 15526 heartbeater.cc:464] Registering TS with master...
I20260807 20:18:20.427546 15526 heartbeater.cc:511] Master 127.30.35.254:35115 requested a full tablet report, sending...
I20260807 20:18:20.428094 15246 ts_manager.cc:194] Registered new tserver with Master: 00b3bd8d996a4257be24e1d6e82b3305 (127.30.35.193:42171)
I20260807 20:18:20.428987 15246 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:51927
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:18:20.445377 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:35115
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:43871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:18:20.524768 15533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:20.524969 15533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:20.524991 15533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:20.526124 15533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:20.526165 15533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:20.526192 15533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:18:20.527583 15533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:43871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:35115
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:20.527803 15533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:20.528012 15533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:20.532752 15538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:20.532745 15539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:20.532753 15541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:20.532878 15533 server_base.cc:1034] running on GCE node
I20260807 20:18:20.533177 15533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:20.533423 15533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:20.534571 15533 hybrid_clock.cc:648] HybridClock initialized: now 1786133900534556 us; error 28 us; skew 500 ppm
Aug 07 20:18:20 dist-test-slave-t7g5 krb5kdc[15183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133900, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:18:20.536983 15533 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:18:20.537371 15533 webserver.cc:460] Webserver started at http://127.30.35.194:43851/ using document root <none> and password file <none>
I20260807 20:18:20.537581 15533 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:20.537627 15533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:20.537784 15533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:20.538748 15533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "37cf4e7b189d438698fe9f3e8cd67289"
format_stamp: "Formatted at 2026-08-07 20:18:20 on dist-test-slave-t7g5"
server_key: "10d0900f4da7aec953b239f13f7b37db"
server_key_iv: "ca42d4a56337e5b962216c15eb773812"
server_key_version: "encryptionkey@0"
I20260807 20:18:20.539067 15533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "37cf4e7b189d438698fe9f3e8cd67289"
format_stamp: "Formatted at 2026-08-07 20:18:20 on dist-test-slave-t7g5"
server_key: "10d0900f4da7aec953b239f13f7b37db"
server_key_iv: "ca42d4a56337e5b962216c15eb773812"
server_key_version: "encryptionkey@0"
I20260807 20:18:20.540262 15533 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:18:20.540905 15551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:20.541054 15533 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:18:20.541148 15533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "37cf4e7b189d438698fe9f3e8cd67289"
format_stamp: "Formatted at 2026-08-07 20:18:20 on dist-test-slave-t7g5"
server_key: "10d0900f4da7aec953b239f13f7b37db"
server_key_iv: "ca42d4a56337e5b962216c15eb773812"
server_key_version: "encryptionkey@0"
I20260807 20:18:20.541210 15533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:20.570866 15533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:20.572657 15533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:20.572794 15533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:20.573016 15533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:20.573313 15533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:20.573347 15533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:20.573376 15533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:20.573400 15533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:20.578744 15533 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:42377
I20260807 20:18:20.578800 15726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:42377 every 8 connection(s)
I20260807 20:18:20.579119 15533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:18:20.579854 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 15533
I20260807 20:18:20.579967 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:18:20.580178 30863 external_mini_cluster.cc:1428] Setting key 3afaba25678d84e3799813db15511df1
Aug 07 20:18:20 dist-test-slave-t7g5 krb5kdc[15183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133900, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:18:20.588171 15325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.580036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:57947 (local address 127.30.35.254:35115)
0807 20:18:20.580090 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:20.580092 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:20.580103 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:18:20.580682 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:20.580684 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:20.580695 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:20.580751 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:20.581687 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.582179 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.583149 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.583340 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.583401 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.585448 (+ 2047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:20.585449 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:20.585449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:18:20.585458 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:20.586903 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:20.587288 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:20.587289 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:20.587289 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:20.587355 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:20.587565 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:20.587566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:20.587566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:20.587701 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:20.587771 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:20.587991 (+ 220us) server_negotiation.cc:299] Negotiation successful
0807 20:18:20.588076 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 20:18:20.588228 15734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.579764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:35115 (local address 127.30.35.194:57947)
0807 20:18:20.579942 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:20.579990 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:20.580594 (+ 604us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:20.580841 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:20.580846 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:20.581380 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:20.581575 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.581580 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.582260 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.582261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.583069 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.583072 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.583426 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.583427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.583561 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.584004 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:20.584012 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:20.585356 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:18:20.586997 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:18:20.587004 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:18:20.587005 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:18:20.587220 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:18:20.587415 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:18:20.587416 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:18:20.587416 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:18:20.587508 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:18:20.587757 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:18:20.587760 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:18:20.587876 (+ 116us) client_negotiation.cc:769] Sending connection context
0807 20:18:20.587950 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 20:18:20.588068 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":97,"threads_started":1}
I20260807 20:18:20.588721 15729 heartbeater.cc:347] Connected to a master server at 127.30.35.254:35115
I20260807 20:18:20.588816 15729 heartbeater.cc:464] Registering TS with master...
I20260807 20:18:20.588989 15729 heartbeater.cc:511] Master 127.30.35.254:35115 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
I20260807 20:18:20.589355 15246 ts_manager.cc:194] Registered new tserver with Master: 37cf4e7b189d438698fe9f3e8cd67289 (127.30.35.194:42377)
I20260807 20:18:20.589751 15246 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:57947
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:18:20.605367 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:35115
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:43871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:18:20.684211 15737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:18:20.684419 15737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:18:20.684449 15737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:18:20.685545 15737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:18:20.685585 15737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:18:20.685617 15737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:18:20.687122 15737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:43871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:35115
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:18:20.687354 15737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:18:20.687553 15737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:18:20.692299 15745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:18:20.692278 15744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:20.692400 15737 server_base.cc:1034] running on GCE node
W20260807 20:18:20.692286 15749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:18:20.692664 15737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:18:20.692884 15737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:18:20.694020 15737 hybrid_clock.cc:648] HybridClock initialized: now 1786133900694005 us; error 31 us; skew 500 ppm
Aug 07 20:18:20 dist-test-slave-t7g5 krb5kdc[15183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133900, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:18:20.696429 15737 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:18:20.696813 15737 webserver.cc:460] Webserver started at http://127.30.35.195:45887/ using document root <none> and password file <none>
I20260807 20:18:20.697001 15737 fs_manager.cc:359] Metadata directory not provided
I20260807 20:18:20.697043 15737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:18:20.697158 15737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:18:20.698165 15737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "40c6f533b65148ff82033ae85f5f65c6"
format_stamp: "Formatted at 2026-08-07 20:18:20 on dist-test-slave-t7g5"
server_key: "2156c90abd492b9d091c228e4f22cebf"
server_key_iv: "b44c33f0fca27e2484692ef9efeff6d5"
server_key_version: "encryptionkey@0"
I20260807 20:18:20.698489 15737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "40c6f533b65148ff82033ae85f5f65c6"
format_stamp: "Formatted at 2026-08-07 20:18:20 on dist-test-slave-t7g5"
server_key: "2156c90abd492b9d091c228e4f22cebf"
server_key_iv: "b44c33f0fca27e2484692ef9efeff6d5"
server_key_version: "encryptionkey@0"
I20260807 20:18:20.699677 15737 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:18:20.700315 15759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:20.700476 15737 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:18:20.700556 15737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "40c6f533b65148ff82033ae85f5f65c6"
format_stamp: "Formatted at 2026-08-07 20:18:20 on dist-test-slave-t7g5"
server_key: "2156c90abd492b9d091c228e4f22cebf"
server_key_iv: "b44c33f0fca27e2484692ef9efeff6d5"
server_key_version: "encryptionkey@0"
I20260807 20:18:20.700608 15737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:18:20.714179 15737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:18:20.715830 15737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:18:20.715942 15737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:18:20.716106 15737 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:18:20.716336 15737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:18:20.716373 15737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:20.716392 15737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:18:20.716408 15737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:18:20.721694 15737 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:32935
I20260807 20:18:20.721750 15916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:32935 every 8 connection(s)
I20260807 20:18:20.722014 15737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
Aug 07 20:18:20 dist-test-slave-t7g5 krb5kdc[15183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133900, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:18:20.729630 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 15737
I20260807 20:18:20.729749 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:18:20.729948 30863 external_mini_cluster.cc:1428] Setting key 0b7ce320976301b7233608a46508e495
I20260807 20:18:20.730762 15325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.722624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:47077 (local address 127.30.35.254:35115)
0807 20:18:20.722664 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:20.722666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:20.722884 (+ 218us) server_negotiation.cc:407] Connection header received
0807 20:18:20.723360 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:20.723362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:20.723374 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:20.723426 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:20.724337 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.724822 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.725802 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.725996 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.726052 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.728068 (+ 2016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:20.728070 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:20.728070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:18:20.728078 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:20.729350 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:20.729747 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:20.729748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:20.729748 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:20.729816 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:20.730118 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:20.730119 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:20.730120 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:20.730268 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:20.730330 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:20.730593 (+ 263us) server_negotiation.cc:299] Negotiation successful
0807 20:18:20.730674 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 20:18:20.730926 15922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.722591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:35115 (local address 127.30.35.195:47077)
0807 20:18:20.722749 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:20.722797 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:20.723267 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:20.723506 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:20.723510 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:20.724060 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:18:20.724240 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.724250 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.724901 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.724903 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.725725 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.725728 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.726063 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.726064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.726193 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.726659 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:18:20.726667 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:18:20.727980 (+ 1313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:18:20.729425 (+ 1445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:18:20.729432 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:18:20.729433 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:18:20.729643 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:18:20.729903 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:18:20.729905 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:18:20.729905 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:18:20.730048 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:18:20.730331 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:18:20.730338 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:18:20.730472 (+ 134us) client_negotiation.cc:769] Sending connection context
0807 20:18:20.730561 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 20:18:20.730706 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260807 20:18:20.731316 15919 heartbeater.cc:347] Connected to a master server at 127.30.35.254:35115
I20260807 20:18:20.731391 15919 heartbeater.cc:464] Registering TS with master...
I20260807 20:18:20.731552 15919 heartbeater.cc:511] Master 127.30.35.254:35115 requested a full tablet report, sending...
I20260807 20:18:20.731891 15246 ts_manager.cc:194] Registered new tserver with Master: 40c6f533b65148ff82033ae85f5f65c6 (127.30.35.195:32935)
I20260807 20:18:20.732236 15246 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:47077
I20260807 20:18:20.741448 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:18:20.748405 15325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.742651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55542 (local address 127.30.35.254:35115)
0807 20:18:20.742713 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:20.742715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:20.742805 (+ 90us) server_negotiation.cc:407] Connection header received
0807 20:18:20.742866 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:20.742867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:20.742877 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:20.742916 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:18:20.743458 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.744004 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.744687 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.744907 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.744961 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.746144 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:18:20.746145 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:18:20.746146 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:18:20.746153 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:18:20.747366 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:20.747669 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:20.747670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:20.747671 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:20.747721 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:18:20.747886 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:18:20.747887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:18:20.747888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:18:20.748027 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:18:20.748117 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:20.748242 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 20:18:20.748318 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 20:18:20.749841 15246 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:18:20.751358 15246 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:18:20.757401 15938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.753460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:42171 (local address 127.0.0.1:51014)
0807 20:18:20.753790 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:20.753799 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:20.753838 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:20.754146 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:20.754147 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:20.754149 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:18:20.754220 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.754222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.755504 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.755506 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.756283 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.756285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.757161 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.757162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.757230 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.757241 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 20:18:20.757293 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 20:18:20.757331 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"mutex_wait_us":16,"thread_start_us":83,"threads_started":1}
I20260807 20:18:20.757424 15941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.753833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51014 (local address 127.30.35.193:42171)
0807 20:18:20.753980 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:20.753985 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:20.753993 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:18:20.754031 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:20.754033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:20.754049 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:20.754130 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:18:20.754295 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.755412 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.756361 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.757088 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.757162 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.757219 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:20.757306 (+ 87us) server_negotiation.cc:299] Negotiation successful
0807 20:18:20.757340 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":81,"threads_started":1}
I20260807 20:18:20.757745 15936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.753460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:42377 (local address 127.0.0.1:41504)
0807 20:18:20.753604 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:20.753613 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:20.753691 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:20.754325 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:20.754326 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:20.754327 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:18:20.754367 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.754369 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.755317 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.755318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.756648 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.756650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.757510 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.757511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.757576 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.757579 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:18:20.757627 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 20:18:20.757687 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":50,"thread_start_us":98,"threads_started":1}
I20260807 20:18:20.757798 15940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.753724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41504 (local address 127.30.35.194:42377)
0807 20:18:20.754158 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:20.754162 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:20.754170 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:18:20.754206 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:20.754209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:20.754223 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:20.754440 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:18:20.754514 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.755219 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.756732 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.757433 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.757495 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.757551 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:20.757679 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 20:18:20.757719 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":89,"threads_started":1}
I20260807 20:18:20.758608 15935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.753434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:32935 (local address 127.0.0.1:52732)
0807 20:18:20.753566 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:20.753604 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:20.753691 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:20.754077 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:20.754081 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:20.754083 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:18:20.754155 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.754157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.755483 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.755484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.756645 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.756648 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.758379 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.758380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.758449 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.758454 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:18:20.758511 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 20:18:20.758548 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":4,"thread_start_us":43,"threads_started":1}
I20260807 20:18:20.758517 15426 tablet_service.cc:1467] Processing CreateTablet for tablet 8099d5e4708442639355cc8eed559084 (DEFAULT_TABLE table=test-table [id=a945997b2dd146769806de89042d4831]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:18:20.758517 15620 tablet_service.cc:1467] Processing CreateTablet for tablet 8099d5e4708442639355cc8eed559084 (DEFAULT_TABLE table=test-table [id=a945997b2dd146769806de89042d4831]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:18:20.758630 15939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.753734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52732 (local address 127.30.35.195:32935)
0807 20:18:20.753925 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:20.753930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:20.753940 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:18:20.753971 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:20.753973 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:20.753985 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:20.754050 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:18:20.754240 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.755348 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.757587 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.758295 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.758377 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.758439 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:20.758521 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 20:18:20.758558 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":75,"threads_started":1}
I20260807 20:18:20.758888 15620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8099d5e4708442639355cc8eed559084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:18:20.758891 15426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8099d5e4708442639355cc8eed559084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:18:20.759506 15824 tablet_service.cc:1467] Processing CreateTablet for tablet 8099d5e4708442639355cc8eed559084 (DEFAULT_TABLE table=test-table [id=a945997b2dd146769806de89042d4831]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:18:20.759815 15824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8099d5e4708442639355cc8eed559084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:18:20.761503 15942 tablet_bootstrap.cc:492] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289: Bootstrap starting.
I20260807 20:18:20.762349 15942 tablet_bootstrap.cc:654] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289: Neither blocks nor log segments found. Creating new log.
I20260807 20:18:20.762804 15942 log.cc:824] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289: Log is configured to *not* fsync() on all Append() calls
I20260807 20:18:20.762815 15945 tablet_bootstrap.cc:492] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6: Bootstrap starting.
I20260807 20:18:20.763036 15943 tablet_bootstrap.cc:492] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305: Bootstrap starting.
I20260807 20:18:20.763507 15942 tablet_bootstrap.cc:492] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289: No bootstrap required, opened a new log
I20260807 20:18:20.763558 15945 tablet_bootstrap.cc:654] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6: Neither blocks nor log segments found. Creating new log.
I20260807 20:18:20.763571 15942 ts_tablet_manager.cc:1397] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:18:20.763623 15943 tablet_bootstrap.cc:654] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305: Neither blocks nor log segments found. Creating new log.
I20260807 20:18:20.764117 15945 log.cc:824] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6: Log is configured to *not* fsync() on all Append() calls
I20260807 20:18:20.764118 15943 log.cc:824] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305: Log is configured to *not* fsync() on all Append() calls
I20260807 20:18:20.764837 15945 tablet_bootstrap.cc:492] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6: No bootstrap required, opened a new log
I20260807 20:18:20.764927 15945 ts_tablet_manager.cc:1397] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:18:20.765116 15943 tablet_bootstrap.cc:492] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305: No bootstrap required, opened a new log
I20260807 20:18:20.765177 15943 ts_tablet_manager.cc:1397] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:18:20.765214 15942 raft_consensus.cc:348] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40c6f533b65148ff82033ae85f5f65c6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 32935 } } peers { permanent_uuid: "37cf4e7b189d438698fe9f3e8cd67289" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 42377 } } peers { permanent_uuid: "00b3bd8d996a4257be24e1d6e82b3305" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 42171 } }
I20260807 20:18:20.765380 15942 raft_consensus.cc:374] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:18:20.765420 15942 raft_consensus.cc:729] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37cf4e7b189d438698fe9f3e8cd67289, State: Initialized, Role: FOLLOWER
I20260807 20:18:20.765556 15942 consensus_queue.cc:260] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40c6f533b65148ff82033ae85f5f65c6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 32935 } } peers { permanent_uuid: "37cf4e7b189d438698fe9f3e8cd67289" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 42377 } } peers { permanent_uuid: "00b3bd8d996a4257be24e1d6e82b3305" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 42171 } }
I20260807 20:18:20.765882 15729 heartbeater.cc:503] Master 127.30.35.254:35115 was elected leader, sending a full tablet report...
I20260807 20:18:20.766103 15942 ts_tablet_manager.cc:1428] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 20:18:20.766763 15945 raft_consensus.cc:348] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40c6f533b65148ff82033ae85f5f65c6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 32935 } } peers { permanent_uuid: "37cf4e7b189d438698fe9f3e8cd67289" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 42377 } } peers { permanent_uuid: "00b3bd8d996a4257be24e1d6e82b3305" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 42171 } }
I20260807 20:18:20.766935 15945 raft_consensus.cc:374] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:18:20.766975 15945 raft_consensus.cc:729] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40c6f533b65148ff82033ae85f5f65c6, State: Initialized, Role: FOLLOWER
I20260807 20:18:20.767083 15945 consensus_queue.cc:260] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40c6f533b65148ff82033ae85f5f65c6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 32935 } } peers { permanent_uuid: "37cf4e7b189d438698fe9f3e8cd67289" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 42377 } } peers { permanent_uuid: "00b3bd8d996a4257be24e1d6e82b3305" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 42171 } }
I20260807 20:18:20.767024 15943 raft_consensus.cc:348] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40c6f533b65148ff82033ae85f5f65c6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 32935 } } peers { permanent_uuid: "37cf4e7b189d438698fe9f3e8cd67289" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 42377 } } peers { permanent_uuid: "00b3bd8d996a4257be24e1d6e82b3305" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 42171 } }
I20260807 20:18:20.767168 15943 raft_consensus.cc:374] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:18:20.767213 15943 raft_consensus.cc:729] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00b3bd8d996a4257be24e1d6e82b3305, State: Initialized, Role: FOLLOWER
I20260807 20:18:20.767351 15945 ts_tablet_manager.cc:1428] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 20:18:20.767321 15943 consensus_queue.cc:260] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40c6f533b65148ff82033ae85f5f65c6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 32935 } } peers { permanent_uuid: "37cf4e7b189d438698fe9f3e8cd67289" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 42377 } } peers { permanent_uuid: "00b3bd8d996a4257be24e1d6e82b3305" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 42171 } }
I20260807 20:18:20.767385 15919 heartbeater.cc:503] Master 127.30.35.254:35115 was elected leader, sending a full tablet report...
I20260807 20:18:20.767571 15943 ts_tablet_manager.cc:1428] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 20:18:20.767618 15526 heartbeater.cc:503] Master 127.30.35.254:35115 was elected leader, sending a full tablet report...
W20260807 20:18:20.829702 15732 tablet.cc:2369] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:18:20.870779 15952 raft_consensus.cc:482] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:18:20.870935 15952 raft_consensus.cc:504] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40c6f533b65148ff82033ae85f5f65c6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 32935 } } peers { permanent_uuid: "37cf4e7b189d438698fe9f3e8cd67289" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 42377 } } peers { permanent_uuid: "00b3bd8d996a4257be24e1d6e82b3305" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 42171 } }
I20260807 20:18:20.871335 15952 leader_election.cc:288] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37cf4e7b189d438698fe9f3e8cd67289 (127.30.35.194:42377), 00b3bd8d996a4257be24e1d6e82b3305 (127.30.35.193:42171)
I20260807 20:18:20.874164 15941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.871680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:38691 (local address 127.30.35.193:42171)
0807 20:18:20.871759 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:20.871761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:20.871772 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:18:20.871799 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:20.871800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:20.871808 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:20.871859 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:18:20.872000 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.872465 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.873462 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.873863 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.873923 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.873933 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:20.874054 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 20:18:20.874092 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 20:18:20.874185 15940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.871588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:58759 (local address 127.30.35.194:42377)
0807 20:18:20.871638 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:20.871640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:20.871649 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:18:20.871678 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:20.871679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:20.871689 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:20.871748 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:18:20.871983 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.872476 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.873451 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.873869 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.873933 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.873941 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:20.874086 (+ 145us) server_negotiation.cc:299] Negotiation successful
0807 20:18:20.874120 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 20:18:20.874209 15955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.871523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:42171 (local address 127.30.35.195:38691)
0807 20:18:20.871716 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:20.871724 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:20.871759 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:20.871873 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:20.871873 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:20.871875 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:18:20.871941 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.871943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.872534 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.872535 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.873368 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.873370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.873930 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.873931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.873994 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.873998 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:18:20.874038 (+ 40us) client_negotiation.cc:240] Negotiation successful
0807 20:18:20.874074 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":35,"thread_start_us":127,"threads_started":1}
I20260807 20:18:20.874192 15922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.871499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:42377 (local address 127.30.35.195:58759)
0807 20:18:20.871549 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:20.871562 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 20:18:20.871613 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:18:20.871807 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:18:20.871808 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:18:20.871810 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:18:20.871880 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.871882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.872559 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.872560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.873363 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:18:20.873365 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.873951 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.873952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:18:20.874018 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.874020 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 20:18:20.874072 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 20:18:20.874106 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":33}
I20260807 20:18:20.874560 15455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8099d5e4708442639355cc8eed559084" candidate_uuid: "40c6f533b65148ff82033ae85f5f65c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00b3bd8d996a4257be24e1d6e82b3305" is_pre_election: true
I20260807 20:18:20.874711 15455 raft_consensus.cc:2454] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40c6f533b65148ff82033ae85f5f65c6 in term 0.
I20260807 20:18:20.874681 15651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8099d5e4708442639355cc8eed559084" candidate_uuid: "40c6f533b65148ff82033ae85f5f65c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37cf4e7b189d438698fe9f3e8cd67289" is_pre_election: true
I20260807 20:18:20.874826 15651 raft_consensus.cc:2454] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40c6f533b65148ff82033ae85f5f65c6 in term 0.
I20260807 20:18:20.874966 15760 leader_election.cc:302] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00b3bd8d996a4257be24e1d6e82b3305, 40c6f533b65148ff82033ae85f5f65c6; no voters:
I20260807 20:18:20.875110 15952 raft_consensus.cc:2781] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:18:20.875164 15952 raft_consensus.cc:482] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:18:20.875180 15952 raft_consensus.cc:3037] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:18:20.875864 15952 raft_consensus.cc:504] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40c6f533b65148ff82033ae85f5f65c6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 32935 } } peers { permanent_uuid: "37cf4e7b189d438698fe9f3e8cd67289" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 42377 } } peers { permanent_uuid: "00b3bd8d996a4257be24e1d6e82b3305" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 42171 } }
I20260807 20:18:20.875988 15952 leader_election.cc:288] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [CANDIDATE]: Term 1 election: Requested vote from peers 37cf4e7b189d438698fe9f3e8cd67289 (127.30.35.194:42377), 00b3bd8d996a4257be24e1d6e82b3305 (127.30.35.193:42171)
I20260807 20:18:20.876144 15455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8099d5e4708442639355cc8eed559084" candidate_uuid: "40c6f533b65148ff82033ae85f5f65c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00b3bd8d996a4257be24e1d6e82b3305"
I20260807 20:18:20.876168 15651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8099d5e4708442639355cc8eed559084" candidate_uuid: "40c6f533b65148ff82033ae85f5f65c6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37cf4e7b189d438698fe9f3e8cd67289"
I20260807 20:18:20.876230 15651 raft_consensus.cc:3037] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:18:20.876223 15455 raft_consensus.cc:3037] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:18:20.876933 15651 raft_consensus.cc:2454] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40c6f533b65148ff82033ae85f5f65c6 in term 1.
I20260807 20:18:20.877043 15455 raft_consensus.cc:2454] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40c6f533b65148ff82033ae85f5f65c6 in term 1.
I20260807 20:18:20.877099 15764 leader_election.cc:302] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37cf4e7b189d438698fe9f3e8cd67289, 40c6f533b65148ff82033ae85f5f65c6; no voters:
I20260807 20:18:20.877182 15952 raft_consensus.cc:2781] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:18:20.877321 15952 raft_consensus.cc:686] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [term 1 LEADER]: Becoming Leader. State: Replica: 40c6f533b65148ff82033ae85f5f65c6, State: Running, Role: LEADER
I20260807 20:18:20.877408 15952 consensus_queue.cc:237] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40c6f533b65148ff82033ae85f5f65c6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 32935 } } peers { permanent_uuid: "37cf4e7b189d438698fe9f3e8cd67289" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 42377 } } peers { permanent_uuid: "00b3bd8d996a4257be24e1d6e82b3305" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 42171 } }
I20260807 20:18:20.878237 15246 catalog_manager.cc:5495] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40c6f533b65148ff82033ae85f5f65c6 (127.30.35.195). New cstate: current_term: 1 leader_uuid: "40c6f533b65148ff82033ae85f5f65c6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40c6f533b65148ff82033ae85f5f65c6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 32935 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37cf4e7b189d438698fe9f3e8cd67289" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 42377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00b3bd8d996a4257be24e1d6e82b3305" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 42171 } health_report { overall_health: UNKNOWN } } }
I20260807 20:18:20.901360 15939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.899004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52736 (local address 127.30.35.195:32935)
0807 20:18:20.899066 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 20:18:20.899068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:18:20.899077 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:18:20.899120 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:18:20.899121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:18:20.899140 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:18:20.899202 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:18:20.899336 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.899806 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.900616 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:18:20.900806 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:18:20.900863 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:18:20.901021 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:18:20.901127 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:18:20.901215 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 20:18:20.901231 (+ 16us) server_negotiation.cc:299] Negotiation successful
0807 20:18:20.901253 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 20:18:20.903208 15455 raft_consensus.cc:1261] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305 [term 1 FOLLOWER]: Refusing update from remote peer 40c6f533b65148ff82033ae85f5f65c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:18:20.903563 15651 raft_consensus.cc:1261] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289 [term 1 FOLLOWER]: Refusing update from remote peer 40c6f533b65148ff82033ae85f5f65c6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:18:20.903574 15956 consensus_queue.cc:1035] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00b3bd8d996a4257be24e1d6e82b3305" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 42171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:18:20.903854 15956 consensus_queue.cc:1035] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37cf4e7b189d438698fe9f3e8cd67289" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 42377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:18:20.905773 15962 mvcc.cc:205] Tried to move back new op lower bound from 7316004458096943104 to 7316004457994506240. Current Snapshot: MvccSnapshot[applied={T|T < 7316004458096943104}]
I20260807 20:18:20.905989 15963 mvcc.cc:205] Tried to move back new op lower bound from 7316004458096943104 to 7316004457994506240. Current Snapshot: MvccSnapshot[applied={T|T < 7316004458096943104}]
I20260807 20:18:20.907485 15966 mvcc.cc:205] Tried to move back new op lower bound from 7316004458096943104 to 7316004457994506240. Current Snapshot: MvccSnapshot[applied={T|T < 7316004458096943104}]
I20260807 20:18:20.908881 15246 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:18:20.908969 15246 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:18:20.909677 15246 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 801cd888df53490bbad0c237d1124aac: Sending DeleteTablet for 3 replicas of tablet 8099d5e4708442639355cc8eed559084
I20260807 20:18:20.910054 15824 tablet_service.cc:1514] Processing DeleteTablet for tablet 8099d5e4708442639355cc8eed559084 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:18:20 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:52732
I20260807 20:18:20.910064 15620 tablet_service.cc:1514] Processing DeleteTablet for tablet 8099d5e4708442639355cc8eed559084 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:18:20 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:41504
I20260807 20:18:20.910069 15426 tablet_service.cc:1514] Processing DeleteTablet for tablet 8099d5e4708442639355cc8eed559084 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:18:20 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:51014
I20260807 20:18:20.910308 15977 tablet_replica.cc:330] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6: stopping tablet replica
I20260807 20:18:20.910302 15980 tablet_replica.cc:330] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305: stopping tablet replica
I20260807 20:18:20.910401 15977 raft_consensus.cc:2229] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:18:20.910403 15980 raft_consensus.cc:2229] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:18:20.910485 15977 raft_consensus.cc:2258] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:18:20.910521 15980 raft_consensus.cc:2258] T 8099d5e4708442639355cc8eed559084 P 00b3bd8d996a4257be24e1d6e82b3305 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:18:20.910616 15979 tablet_replica.cc:330] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289: stopping tablet replica
I20260807 20:18:20.910749 15979 raft_consensus.cc:2229] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:18:20.910820 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 15342
I20260807 20:18:20.910848 15979 raft_consensus.cc:2258] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:18:20.916189 15977 ts_tablet_manager.cc:1905] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:18:20.918644 15979 ts_tablet_manager.cc:1905] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:18:20.919912 15979 ts_tablet_manager.cc:1918] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:18:20.919974 15979 log.cc:1196] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/8099d5e4708442639355cc8eed559084
I20260807 20:18:20.920183 15979 ts_tablet_manager.cc:1939] T 8099d5e4708442639355cc8eed559084 P 37cf4e7b189d438698fe9f3e8cd67289: Deleting consensus metadata
I20260807 20:18:20.920609 15226 catalog_manager.cc:4841] TS 37cf4e7b189d438698fe9f3e8cd67289 (127.30.35.194:42377): tablet 8099d5e4708442639355cc8eed559084 (table test-table [id=a945997b2dd146769806de89042d4831]) successfully deleted
I20260807 20:18:20.922370 15977 ts_tablet_manager.cc:1918] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:18:20.922442 15977 log.cc:1196] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/8099d5e4708442639355cc8eed559084
I20260807 20:18:20.922684 15977 ts_tablet_manager.cc:1939] T 8099d5e4708442639355cc8eed559084 P 40c6f533b65148ff82033ae85f5f65c6: Deleting consensus metadata
I20260807 20:18:20.923085 15227 catalog_manager.cc:4841] TS 40c6f533b65148ff82033ae85f5f65c6 (127.30.35.195:32935): tablet 8099d5e4708442639355cc8eed559084 (table test-table [id=a945997b2dd146769806de89042d4831]) successfully deleted
W20260807 20:18:20.927052 15223 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:42171 (error 108)
I20260807 20:18:20.927590 15935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:18:20.927451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:42171 (local address 127.0.0.1:51028)
0807 20:18:20.927510 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 20:18:20.927553 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:42171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260807 20:18:20.927619 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 15533
W20260807 20:18:20.936113 15223 catalog_manager.cc:4584] TS 00b3bd8d996a4257be24e1d6e82b3305 (127.30.35.193:42171): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8099d5e4708442639355cc8eed559084: Network error: Client connection negotiation failed: client connection to 127.30.35.193:42171: connect: Connection refused (error 111)
I20260807 20:18:20.941375 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 15737
I20260807 20:18:20.949051 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 15200
2026-08-07T20:18:20Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2137 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:18:21 dist-test-slave-t7g5 krb5kdc[15993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:18:21 dist-test-slave-t7g5 krb5kdc[15993](info): set up 2 sockets
Aug 07 20:18:21 dist-test-slave-t7g5 krb5kdc[15993](info): commencing operation
krb5kdc: starting...
W20260807 20:18:22.092753 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:18:22 dist-test-slave-t7g5 krb5kdc[15993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133902, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:18:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:18:22Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.30.35.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.30.35.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/rangeradmin_127.30.35.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/rangeradmin_127.30.35.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.30.35.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.30.35.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/rangerlookup_127.30.35.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/rangerlookup_127.30.35.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.35.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.30.35.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/HTTP_127.30.35.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/HTTP_127.30.35.212@KRBTEST.COM.keytab.
I20260807 20:18:22.258468 30863 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskX5HdRu/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/postgres -l logfile start
2026-08-07 20:18:24.556 UTC [16033] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 20:18:24.556 UTC [16033] LOG: listening on IPv4 address "127.30.35.212", port 60751
2026-08-07 20:18:24.560 UTC [16033] LOG: listening on Unix socket "/tmp/.s.PGSQL.60751"
2026-08-07 20:18:24.580 UTC [16036] LOG: database system was shut down at 2026-08-07 20:18:23 UTC
2026-08-07 20:18:24.584 UTC [16033] LOG: database system is ready to accept connections
I20260807 20:18:25.632814 30863 mini_postgres.cc:96] Postgres bound to 60751
2026-08-07 20:18:25.639 UTC [16046] FATAL: database "slave" does not exist
127.30.35.212:60751 - accepting connections
I20260807 20:18:25.640290 30863 mini_ranger.cc:161] Starting Ranger...
I20260807 20:18:25.654893 30863 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 20:18:26.097563 30863 mini_ranger.cc:87] Created ranger Postgres database
I20260807 20:18:26.097637 30863 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-admin
2026-08-07 20:18:26,374 [I] DB FLAVOR :POSTGRES
2026-08-07 20:18:26,374 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 20:18:26,374 [I] Checking connection..
2026-08-07 20:18:26,374 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 20:18:26,620 [I] Checking connection passed.
2026-08-07 20:18:26,620 [I] --------- Verifying version history table ---------
2026-08-07 20:18:26,620 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 20:18:26,877 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 20:18:26,878 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 20:18:27,135 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 20:18:27,135 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 20:18:27,135 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 20:18:27.384 UTC [16144] WARNING: there is no transaction in progress
2026-08-07 20:18:27,392 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 20:18:27,392 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 20:18:27,653 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 20:18:27,653 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 20:18:27,653 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 20:18:27,908 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 20:18:28,148 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-t7g5.c.gcp-upstream.internal','N') ;"
2026-08-07 20:18:28,391 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 20:18:28,634 [I] Table x_portal_user does not exist in database ranger
2026-08-07 20:18:28,635 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 20:18:28,893 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 20:18:28,894 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 20:18:29,145 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 20:18:29,377 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 20:18:29,377 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 20:18:30.259 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.274 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.289 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.303 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.318 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.334 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.386 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.392 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.405 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.418 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.430 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.445 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.457 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.464 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.469 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:30.475 UTC [16298] WARNING: there is no transaction in progress
2026-08-07 20:18:31,049 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 20:18:31,049 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 20:18:31,300 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 20:18:31,300 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 20:18:31,531 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 20:18:31,532 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 20:18:31,769 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 20:18:31,769 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 20:18:32,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 20:18:32,275 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-t7g5.c.gcp-upstream.internal';"
2026-08-07 20:18:32,523 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 20:18:32,523 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 20:18:32,759 [I] DB_PATCHES have already been applied
I20260807 20:18:32.765364 30863 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-admin:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskX5HdRu/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 20:18:32.765427 30863 mini_ranger.cc:193] Using host: 127.30.35.212
I20260807 20:18:32.769030 30863 mini_ranger.cc:227] Ranger admin URL: http://127.30.35.212:60203
Aug 07, 2026 8:18:33 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 8:18:33 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 8:18:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 8:18:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 8:18:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 8:18:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 8:18:33 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 20:18:34.017357 30863 mini_ranger.cc:160] Time spent starting Ranger: real 8.377s user 0.002s sys 0.007s
Aug 07, 2026 8:18:53 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 8:18:53 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 8:18:53 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 8:18:53 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 8:18:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 8:18:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 8:18:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 8:18:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 8:18:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 8:18:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 8:18:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 8:18:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 8:18:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 8:18:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 8:18:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 8:18:53 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 8:18:53 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 8:18:54 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 20:18:55.284351 30863 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.30.35.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.30.35.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/rangerkms_127.30.35.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/rangerkms_127.30.35.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.35.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.30.35.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.35.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/HTTP_127.30.35.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.35.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/HTTP_127.30.35.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 20:18:55 dist-test-slave-t7g5 krb5kdc[15993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133935, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 20:18:55.365024 30863 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 20:18:55.374178 30863 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 20:18:56.180187 30863 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 20:18:56.180262 30863 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-kms
I20260807 20:18:56.180280 30863 mini_ranger_kms.cc:227] Using postgres at 127.30.35.212:60751
2026-08-07 20:18:56,686 [I] DB FLAVOR :POSTGRES
2026-08-07 20:18:56,686 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 20:18:56,687 [I] Checking connection
2026-08-07 20:18:56,687 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 20:18:56,927 [I] connection success
2026-08-07 20:18:56,927 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 20:18:56,927 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 20:18:56,927 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 20:18:57,157 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 20:18:57,157 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 20:18:57,158 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 20:18:57,158 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:60751/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 20:18:57,419 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 20:18:57.844031 30863 mini_ranger_kms.cc:310] Created kms service
I20260807 20:18:58.026798 30863 mini_ranger_kms.cc:326] Created kudu user
I20260807 20:18:58.070485 30863 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 20:18:58 dist-test-slave-t7g5 krb5kdc[15993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133935, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:18:58.466935 30863 mini_ranger_kms.cc:384] Added ranger policy
I20260807 20:18:58.467054 30863 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-kms:/tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 20:18:58.467080 30863 mini_ranger_kms.cc:240] Using host: 127.30.35.212
I20260807 20:18:58.471292 30863 mini_ranger_kms.cc:276] Ranger KMS PID: 16567
I20260807 20:18:58.471428 30863 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.30.35.212:50131
Aug 07, 2026 8:18:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 8:18:59 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 8:18:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 8:18:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 8:18:59 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 8:18:59 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 20:19:00 dist-test-slave-t7g5 krb5kdc[15993](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786133940, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.35.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:00.953722 30863 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.589s user 0.007s sys 0.217s
I20260807 20:19:00.953871 30863 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 20:19:00.953960 30863 mini_ranger_kms.cc:401] 127.30.35.212:50131/kms/v1/keys
Aug 07 20:19:01 dist-test-slave-t7g5 krb5kdc[15993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133940, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.35.212@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
Aug 07 20:19:01 dist-test-slave-t7g5 krb5kdc[15993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133940, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.35.212@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
Aug 07 20:19:03 dist-test-slave-t7g5 krb5kdc[15993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133943, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:19:03.772083 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:36975
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:40151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:36975
--ranger_config_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.35.212:50131/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:19:03.858409 16647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:03.858623 16647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:03.858654 16647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:03.859849 16647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:19:03.859896 16647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:03.859915 16647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:03.859930 16647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:19:03.859946 16647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:19:03.861503 16647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/wal
--ranger_kms_url=127.30.35.212:50131/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:36975
--ranger_config_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:36975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:03.861779 16647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:03.861992 16647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 20:19:03.867172 16647 server_base.cc:1034] running on GCE node
W20260807 20:19:03.867142 16653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:03.867277 16652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:03.867157 16656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:03.867691 16647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:03.868011 16647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:03.869181 16647 hybrid_clock.cc:648] HybridClock initialized: now 1786133943869161 us; error 34 us; skew 500 ppm
Aug 07 20:19:03 dist-test-slave-t7g5 krb5kdc[15993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133943, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:03.872260 16647 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:19:03.872766 16647 webserver.cc:460] Webserver started at http://127.30.35.254:39261/ using document root <none> and password file <none>
I20260807 20:19:03.873027 16647 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:03.873076 16647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:03.873203 16647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 20:19:03 dist-test-slave-t7g5 krb5kdc[15993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133943, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:03.921245 16647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "fd15c1c8574547f0b843d051a5978a4e"
format_stamp: "Formatted at 2026-08-07 20:19:03 on dist-test-slave-t7g5"
server_key: "9fcb8e6cb10c72a5eb82aa63da081d9e"
server_key_iv: "d2fcbea6bb1c8c15b83f3d2e764d616d"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:03.921717 16647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "fd15c1c8574547f0b843d051a5978a4e"
format_stamp: "Formatted at 2026-08-07 20:19:03 on dist-test-slave-t7g5"
server_key: "9fcb8e6cb10c72a5eb82aa63da081d9e"
server_key_iv: "d2fcbea6bb1c8c15b83f3d2e764d616d"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:03.923496 16647 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:19:03.934870 16667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:03.935026 16647 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 20:19:03.935117 16647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "fd15c1c8574547f0b843d051a5978a4e"
format_stamp: "Formatted at 2026-08-07 20:19:03 on dist-test-slave-t7g5"
server_key: "9fcb8e6cb10c72a5eb82aa63da081d9e"
server_key_iv: "d2fcbea6bb1c8c15b83f3d2e764d616d"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:03.935205 16647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:03.947047 16647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:03.948894 16647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:03.949038 16647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:03.954161 16647 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:36975
I20260807 20:19:03.954186 16744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:36975 every 8 connection(s)
I20260807 20:19:03.954553 16647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:19:03.955359 16745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:19:03.957809 16745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e: Bootstrap starting.
I20260807 20:19:03.958395 16745 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e: Neither blocks nor log segments found. Creating new log.
I20260807 20:19:03.958729 16745 log.cc:824] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e: Log is configured to *not* fsync() on all Append() calls
I20260807 20:19:03.958853 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 16647
I20260807 20:19:03.958957 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:19:03.959160 30863 external_mini_cluster.cc:1428] Setting key b5e1a4469b26588fc1a88049f02237b4
I20260807 20:19:03.959959 16745 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e: No bootstrap required, opened a new log
I20260807 20:19:03.963009 16745 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd15c1c8574547f0b843d051a5978a4e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36975 } }
I20260807 20:19:03.963189 16745 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:19:03.963267 16745 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd15c1c8574547f0b843d051a5978a4e, State: Initialized, Role: FOLLOWER
I20260807 20:19:03.963446 16745 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd15c1c8574547f0b843d051a5978a4e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36975 } }
I20260807 20:19:03.963625 16745 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:19:03.963680 16745 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:19:03.963724 16745 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:19:03.964478 16745 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd15c1c8574547f0b843d051a5978a4e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36975 } }
I20260807 20:19:03.964592 16745 leader_election.cc:302] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd15c1c8574547f0b843d051a5978a4e; no voters:
I20260807 20:19:03.964797 16745 leader_election.cc:288] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:19:03.964851 16754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [term 1 FOLLOWER]: Leader election won for term 1
Aug 07 20:19:03 dist-test-slave-t7g5 krb5kdc[15993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133943, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:03.965161 16745 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:19:03.965694 16754 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [term 1 LEADER]: Becoming Leader. State: Replica: fd15c1c8574547f0b843d051a5978a4e, State: Running, Role: LEADER
I20260807 20:19:03.965862 16754 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd15c1c8574547f0b843d051a5978a4e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36975 } }
I20260807 20:19:03.968191 16756 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd15c1c8574547f0b843d051a5978a4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd15c1c8574547f0b843d051a5978a4e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36975 } } }
I20260807 20:19:03.968263 16756 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [sys.catalog]: This master's current role is: LEADER
I20260807 20:19:03.968633 16779 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:19:03.968798 16758 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd15c1c8574547f0b843d051a5978a4e. Latest consensus state: current_term: 1 leader_uuid: "fd15c1c8574547f0b843d051a5978a4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd15c1c8574547f0b843d051a5978a4e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36975 } } }
I20260807 20:19:03.968866 16758 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e [sys.catalog]: This master's current role is: LEADER
I20260807 20:19:03.968918 16745 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 20:19:03.969156 16779 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:19:03.973380 16752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:03.959682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57692 (local address 127.30.35.254:36975)
0807 20:19:03.959933 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:03.959941 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:03.959965 (+ 24us) server_negotiation.cc:407] Connection header received
0807 20:19:03.960423 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:03.960430 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:03.960480 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:03.960607 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:03.961249 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:03.962199 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:03.962928 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:03.963432 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:03.963532 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:03.966018 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:03.966022 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:03.966022 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:03.966034 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:03.967655 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:03.968535 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:03.968538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:03.968539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:03.968651 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:03.969142 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:03.969143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:03.969144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:03.971005 (+ 1861us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:03.971638 (+ 633us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:03.972343 (+ 705us) server_negotiation.cc:299] Negotiation successful
0807 20:19:03.973044 (+ 701us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":88,"threads_started":1}
I20260807 20:19:03.974748 16779 catalog_manager.cc:1347] Generated new cluster ID: abbeaa37578d4584bd96a0eb93146408
I20260807 20:19:03.974807 16779 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:19:03.980573 16779 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:19:03.981321 16779 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:19:03.986419 16779 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e: Generated new TSK 0
I20260807 20:19:03.986657 16779 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:19:04.696470 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.35.212:50131/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36975
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:40151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:19:04.788779 16818 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:04.788985 16818 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:04.789006 16818 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:04.790139 16818 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:04.790180 16818 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:04.790208 16818 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:19:04.791666 16818 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.30.35.212:50131/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16818
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:04.791874 16818 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:04.792086 16818 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:04.796885 16824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:04.796912 16825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:04.796885 16828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:04.797225 16818 server_base.cc:1034] running on GCE node
I20260807 20:19:04.797451 16818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:04.797740 16818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:04.798925 16818 hybrid_clock.cc:648] HybridClock initialized: now 1786133944798906 us; error 34 us; skew 500 ppm
Aug 07 20:19:04 dist-test-slave-t7g5 krb5kdc[15993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133944, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:04.802075 16818 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:19:04.802657 16818 webserver.cc:460] Webserver started at http://127.30.35.193:39109/ using document root <none> and password file <none>
I20260807 20:19:04.802915 16818 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:04.802989 16818 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:04.803136 16818 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 20:19:04 dist-test-slave-t7g5 krb5kdc[15993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133944, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:04.819737 16818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "ac8363d66204419bb0df25d16270ec20"
format_stamp: "Formatted at 2026-08-07 20:19:04 on dist-test-slave-t7g5"
server_key: "051d856082c002d00a775c00dbe92cca"
server_key_iv: "2e0ba7698191a87866c31a9d9542f359"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:04.820308 16818 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "ac8363d66204419bb0df25d16270ec20"
format_stamp: "Formatted at 2026-08-07 20:19:04 on dist-test-slave-t7g5"
server_key: "051d856082c002d00a775c00dbe92cca"
server_key_iv: "2e0ba7698191a87866c31a9d9542f359"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:04.822291 16818 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260807 20:19:04.836475 16838 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:04.836750 16818 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:19:04.836872 16818 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "ac8363d66204419bb0df25d16270ec20"
format_stamp: "Formatted at 2026-08-07 20:19:04 on dist-test-slave-t7g5"
server_key: "051d856082c002d00a775c00dbe92cca"
server_key_iv: "2e0ba7698191a87866c31a9d9542f359"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:04.836979 16818 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:04.865828 16818 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:04.868495 16818 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:04.868743 16818 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:04.869132 16818 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:19:04.869614 16818 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:19:04.869737 16818 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:04.869843 16818 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:19:04.869922 16818 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:04.879094 16818 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:44209
I20260807 20:19:04.879565 16818 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:19:04.881142 17011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:44209 every 8 connection(s)
I20260807 20:19:04.882306 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 16818
I20260807 20:19:04.882421 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:19:04.882643 30863 external_mini_cluster.cc:1428] Setting key 2f37af4aa8ea28fa205d762af1c306e0
Aug 07 20:19:04 dist-test-slave-t7g5 krb5kdc[15993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133944, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
I20260807 20:19:04.893330 17018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:04.882049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:36975 (local address 127.30.35.193:60053)
0807 20:19:04.882657 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:04.882707 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:04.883241 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:04.883576 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:04.883582 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:04.883803 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:04.884083 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:04.884089 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:04.885073 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:04.885074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:04.886427 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:04.886431 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:04.886985 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:04.886986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:04.887133 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:04.887820 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:04.887830 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:04.889533 (+ 1703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:04.891589 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:04.891596 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:04.891599 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:04.891905 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:04.892133 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:04.892134 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:04.892134 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:04.892288 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:04.892612 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:04.892620 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:04.892787 (+ 167us) client_negotiation.cc:769] Sending connection context
0807 20:19:04.892908 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 20:19:04.893073 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":93,"threads_started":1}
I20260807 20:19:04.893819 17016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:04.881830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:60053 (local address 127.30.35.254:36975)
0807 20:19:04.882008 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:04.882010 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:04.882800 (+ 790us) server_negotiation.cc:407] Connection header received
0807 20:19:04.883400 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:04.883401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:04.883414 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:04.883479 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:04.884189 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:04.884958 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:04.886532 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:04.886837 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:04.886907 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:04.889647 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:04.889666 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:04.889667 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:04.889675 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:04.891492 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:04.891994 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:04.891995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:04.891995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:04.892065 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:04.892370 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:04.892371 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:04.892372 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:04.892518 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:04.892581 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:04.893603 (+ 1022us) server_negotiation.cc:299] Negotiation successful
0807 20:19:04.893717 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":96,"threads_started":1}
I20260807 20:19:04.894207 17014 heartbeater.cc:347] Connected to a master server at 127.30.35.254:36975
I20260807 20:19:04.894321 17014 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:04.894507 17014 heartbeater.cc:511] Master 127.30.35.254:36975 requested a full tablet report, sending...
I20260807 20:19:04.895139 16695 ts_manager.cc:194] Registered new tserver with Master: ac8363d66204419bb0df25d16270ec20 (127.30.35.193:44209)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
I20260807 20:19:04.896062 16695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:60053
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:19:04.910965 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.35.212:50131/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36975
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:40151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:19:05.028069 17025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:05.028381 17025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:05.028424 17025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:05.030293 17025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:05.030360 17025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:05.030400 17025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:19:05.032761 17025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.30.35.212:50131/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:05.033170 17025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:05.033509 17025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:05.040053 17043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:05.040041 17038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:05.040431 17037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:05.040995 17025 server_base.cc:1034] running on GCE node
I20260807 20:19:05.041261 17025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:05.041555 17025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:05.042726 17025 hybrid_clock.cc:648] HybridClock initialized: now 1786133945042710 us; error 52 us; skew 500 ppm
Aug 07 20:19:05 dist-test-slave-t7g5 krb5kdc[15993](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786133945, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 07 20:19:05 dist-test-slave-t7g5 krb5kdc[15993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133945, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:05.046001 17025 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:19:05.046552 17025 webserver.cc:460] Webserver started at http://127.30.35.194:40569/ using document root <none> and password file <none>
I20260807 20:19:05.046806 17025 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:05.046869 17025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:05.047056 17025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 20:19:05 dist-test-slave-t7g5 krb5kdc[15993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133945, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:05.072026 17025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "05b606ac8d1946ea8a38e043a77904d2"
format_stamp: "Formatted at 2026-08-07 20:19:05 on dist-test-slave-t7g5"
server_key: "8cb7ad9eeef565c4530769324be01a8b"
server_key_iv: "ff1d4ccff80ea735048973cc6ba57966"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:05.078969 17025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "05b606ac8d1946ea8a38e043a77904d2"
format_stamp: "Formatted at 2026-08-07 20:19:05 on dist-test-slave-t7g5"
server_key: "8cb7ad9eeef565c4530769324be01a8b"
server_key_iv: "ff1d4ccff80ea735048973cc6ba57966"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:05.083425 17025 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.000s
I20260807 20:19:05.098924 17053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:05.099157 17025 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 20:19:05.099238 17025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "05b606ac8d1946ea8a38e043a77904d2"
format_stamp: "Formatted at 2026-08-07 20:19:05 on dist-test-slave-t7g5"
server_key: "8cb7ad9eeef565c4530769324be01a8b"
server_key_iv: "ff1d4ccff80ea735048973cc6ba57966"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:05.099319 17025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:05.119681 17025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:05.122282 17025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:05.122433 17025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:05.122673 17025 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:19:05.123091 17025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:19:05.123136 17025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:05.123170 17025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:19:05.123188 17025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:05.131095 17025 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:38825
I20260807 20:19:05.131677 17025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:19:05.133574 17233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:38825 every 8 connection(s)
I20260807 20:19:05.138891 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 17025
I20260807 20:19:05.139011 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:19:05.139205 30863 external_mini_cluster.cc:1428] Setting key a69d87b4c4df4fee792d431861ca30a1
Aug 07 20:19:05 dist-test-slave-t7g5 krb5kdc[15993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133945, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:05.151070 17016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.135589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:55651 (local address 127.30.35.254:36975)
0807 20:19:05.135639 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:05.135641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:05.136932 (+ 1291us) server_negotiation.cc:407] Connection header received
0807 20:19:05.137848 (+ 916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:05.137850 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:05.137869 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:05.137902 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:05.142433 (+ 4531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.143180 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.144671 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.144987 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.145038 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.147653 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:05.147655 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:05.147655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:05.147663 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:05.149362 (+ 1699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:05.149894 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:05.149896 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:05.149896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:05.149959 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:05.150254 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:05.150255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:05.150256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:05.150397 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:05.150453 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:05.150820 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 20:19:05.150955 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:19:05.151857 17236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.135272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:36975 (local address 127.30.35.194:55651)
0807 20:19:05.136767 (+ 1495us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:05.136817 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:05.137699 (+ 882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:05.138114 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:05.138120 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:05.138434 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:05.142312 (+ 3878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:05.142321 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.143306 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.143307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:05.144564 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:05.144568 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.145135 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.145136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:05.145282 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.145869 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:05.145879 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:05.147541 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:05.149458 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:05.149465 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:05.149467 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:05.149784 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:05.150029 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:05.150029 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:05.150030 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:05.150169 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:05.150489 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:05.150495 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:05.150658 (+ 163us) client_negotiation.cc:769] Sending connection context
0807 20:19:05.151425 (+ 767us) client_negotiation.cc:240] Negotiation successful
0807 20:19:05.151610 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1451,"thread_start_us":89,"threads_started":1}
I20260807 20:19:05.152535 17234 heartbeater.cc:347] Connected to a master server at 127.30.35.254:36975
I20260807 20:19:05.152635 17234 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:05.152849 17234 heartbeater.cc:511] Master 127.30.35.254:36975 requested a full tablet report, sending...
I20260807 20:19:05.153205 16695 ts_manager.cc:194] Registered new tserver with Master: 05b606ac8d1946ea8a38e043a77904d2 (127.30.35.194:38825)
I20260807 20:19:05.153682 16695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:55651
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:19:05.190570 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.35.212:50131/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36975
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:40151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:19:05.319279 17240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:05.319629 17240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:05.319729 17240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:05.321447 17240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:05.321555 17240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:05.321641 17240 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:19:05.323843 17240 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.30.35.212:50131/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:05.324306 17240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:05.324607 17240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:05.331807 17252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:05.332101 17254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:05.333276 17240 server_base.cc:1034] running on GCE node
W20260807 20:19:05.333813 17250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:05.334149 17240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:05.334455 17240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:05.335628 17240 hybrid_clock.cc:648] HybridClock initialized: now 1786133945335603 us; error 38 us; skew 500 ppm
Aug 07 20:19:05 dist-test-slave-t7g5 krb5kdc[15993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133945, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:05.339272 17240 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:19:05.339823 17240 webserver.cc:460] Webserver started at http://127.30.35.195:37723/ using document root <none> and password file <none>
I20260807 20:19:05.340097 17240 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:05.340152 17240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:05.340309 17240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 20:19:05 dist-test-slave-t7g5 krb5kdc[15993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133945, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:05.354631 17240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "ae12dd77cde942f781c50a3ef97561e1"
format_stamp: "Formatted at 2026-08-07 20:19:05 on dist-test-slave-t7g5"
server_key: "e6327234c1b1ebde4f2e1885704dddb7"
server_key_iv: "fbb849d2f0fe96aa32eb1c84c5b7f43b"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:05.355219 17240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "ae12dd77cde942f781c50a3ef97561e1"
format_stamp: "Formatted at 2026-08-07 20:19:05 on dist-test-slave-t7g5"
server_key: "e6327234c1b1ebde4f2e1885704dddb7"
server_key_iv: "fbb849d2f0fe96aa32eb1c84c5b7f43b"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:05.357523 17240 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260807 20:19:05.381326 17267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:05.381580 17240 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 20:19:05.381687 17240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "ae12dd77cde942f781c50a3ef97561e1"
format_stamp: "Formatted at 2026-08-07 20:19:05 on dist-test-slave-t7g5"
server_key: "e6327234c1b1ebde4f2e1885704dddb7"
server_key_iv: "fbb849d2f0fe96aa32eb1c84c5b7f43b"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:05.381786 17240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:05.414896 17240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:05.417264 17240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:05.417407 17240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:05.417627 17240 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:19:05.418077 17240 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:19:05.418124 17240 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:05.418154 17240 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:19:05.418197 17240 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:05.426921 17240 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:38065
I20260807 20:19:05.427098 17428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:38065 every 8 connection(s)
I20260807 20:19:05.427420 17240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
Aug 07 20:19:05 dist-test-slave-t7g5 krb5kdc[15993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133945, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:05.436539 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 17240
I20260807 20:19:05.436655 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:19:05.436859 30863 external_mini_cluster.cc:1428] Setting key cc18581eeb9bc1f4650432af5a67f79d
I20260807 20:19:05.459131 17016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.428232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:59633 (local address 127.30.35.254:36975)
0807 20:19:05.428292 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:05.428294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:05.428633 (+ 339us) server_negotiation.cc:407] Connection header received
0807 20:19:05.429358 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:05.429360 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:05.429373 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:05.429439 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:05.430307 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.431056 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.432608 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.432892 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.432961 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.435833 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:05.435835 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:05.435835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:05.435845 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:05.438378 (+ 2533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:05.457951 (+ 19573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:05.457953 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:05.457953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:05.458046 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:05.458368 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:05.458369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:05.458370 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:05.458511 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:05.458560 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:05.458928 (+ 368us) server_negotiation.cc:299] Negotiation successful
0807 20:19:05.459031 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:19:05.460023 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.428222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:36975 (local address 127.30.35.195:59633)
0807 20:19:05.428452 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:05.428510 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:05.429214 (+ 704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:05.429533 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:05.429539 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:05.429847 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:05.430201 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:05.430210 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.431160 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.431161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:05.432509 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:05.432513 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.432989 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.432991 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:05.433168 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.433910 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:05.433923 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:05.435704 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:05.438456 (+ 2752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:05.438463 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:05.438466 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:05.457828 (+ 19362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:05.458118 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:05.458118 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:05.458119 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:05.458278 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:05.458592 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:05.458600 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:05.458780 (+ 180us) client_negotiation.cc:769] Sending connection context
0807 20:19:05.459580 (+ 800us) client_negotiation.cc:240] Negotiation successful
0807 20:19:05.459774 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":100,"threads_started":1}
I20260807 20:19:05.460734 17429 heartbeater.cc:347] Connected to a master server at 127.30.35.254:36975
I20260807 20:19:05.460834 17429 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:05.461050 17429 heartbeater.cc:511] Master 127.30.35.254:36975 requested a full tablet report, sending...
I20260807 20:19:05.461463 16695 ts_manager.cc:194] Registered new tserver with Master: ae12dd77cde942f781c50a3ef97561e1 (127.30.35.195:38065)
I20260807 20:19:05.461994 16695 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:59633
I20260807 20:19:05.466114 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:19:05.481772 17016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.473931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57696 (local address 127.30.35.254:36975)
0807 20:19:05.473980 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:05.473982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:05.474366 (+ 384us) server_negotiation.cc:407] Connection header received
0807 20:19:05.474462 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:05.474463 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:05.474475 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:05.474503 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:05.475291 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.476057 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.477089 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.477368 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.477406 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.479003 (+ 1597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:05.479004 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:05.479005 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:05.479012 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:05.480573 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:05.480950 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:05.480951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:05.480952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:05.481006 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:05.481183 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:05.481184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:05.481184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:05.481311 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:05.481385 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:05.481578 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 20:19:05.481675 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:19:05.483927 16695 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57696:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:19:05.486164 16695 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:19:05.503197 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.496982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:38065 (local address 127.0.0.1:47784)
0807 20:19:05.497907 (+ 925us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:05.497950 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:05.498014 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:05.498322 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:05.498326 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:05.498329 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:19:05.498486 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:05.498489 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.500060 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.500061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:05.501404 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:05.501408 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.502871 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.502872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:05.502966 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.502982 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 20:19:05.503054 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 20:19:05.503110 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":892,"thread_start_us":85,"threads_started":1}
I20260807 20:19:05.504071 17455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.497512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47784 (local address 127.30.35.195:38065)
0807 20:19:05.497768 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:05.497772 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:05.498023 (+ 251us) server_negotiation.cc:407] Connection header received
0807 20:19:05.498102 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:05.498105 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:05.498123 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:05.498206 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:19:05.498577 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.499983 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.501546 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.502666 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.502748 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.502834 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:05.503751 (+ 917us) server_negotiation.cc:299] Negotiation successful
0807 20:19:05.503980 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":102,"threads_started":1}
I20260807 20:19:05.505800 17339 tablet_service.cc:1467] Processing CreateTablet for tablet 77adb76eacc8458c859598c5248bf998 (DEFAULT_TABLE table=test-table [id=a6b415c85312429f836383ad599d010f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:19:05.506219 17339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77adb76eacc8458c859598c5248bf998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:19:05.515018 17450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.497217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:44209 (local address 127.0.0.1:60428)
0807 20:19:05.505743 (+ 8526us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:05.505755 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:05.505818 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:05.510367 (+ 4549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:05.510368 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:05.510370 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:19:05.510414 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:05.510416 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.511678 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.511679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:05.512852 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:05.512855 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.514778 (+ 1923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.514779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:05.514843 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.514847 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:19:05.514897 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 20:19:05.514937 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8506,"thread_start_us":88,"threads_started":1}
I20260807 20:19:05.515563 17454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.497459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60428 (local address 127.30.35.193:44209)
0807 20:19:05.497627 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:05.497632 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:05.510128 (+ 12496us) server_negotiation.cc:407] Connection header received
0807 20:19:05.510174 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:05.510176 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:05.510193 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:05.510284 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:19:05.510488 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.511569 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.513365 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.514592 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.514662 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.514728 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:05.515415 (+ 687us) server_negotiation.cc:299] Negotiation successful
0807 20:19:05.515480 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":69,"threads_started":1}
I20260807 20:19:05.516415 16912 tablet_service.cc:1467] Processing CreateTablet for tablet 77adb76eacc8458c859598c5248bf998 (DEFAULT_TABLE table=test-table [id=a6b415c85312429f836383ad599d010f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:19:05.516815 16912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77adb76eacc8458c859598c5248bf998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:19:05.524979 17452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.497105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49048 (local address 127.30.35.194:38825)
0807 20:19:05.497267 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:05.497272 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:05.503911 (+ 6639us) server_negotiation.cc:407] Connection header received
0807 20:19:05.504508 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:05.504512 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:05.504529 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:05.504625 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:19:05.520993 (+ 16368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.522176 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.523515 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.524399 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.524449 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.524512 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:05.524732 (+ 220us) server_negotiation.cc:299] Negotiation successful
0807 20:19:05.524788 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":75,"threads_started":1}
I20260807 20:19:05.525391 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.496983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:38825 (local address 127.0.0.1:49048)
0807 20:19:05.503840 (+ 6857us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:05.503853 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:05.504327 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:05.505031 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:05.505032 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:05.505034 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:19:05.505066 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:05.505067 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.522312 (+ 17245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.522313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:05.523402 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:05.523406 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.524574 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.524575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:05.524637 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.524640 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:19:05.525268 (+ 628us) client_negotiation.cc:240] Negotiation successful
0807 20:19:05.525314 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6841,"mutex_wait_us":5,"thread_start_us":98,"threads_started":1}
I20260807 20:19:05.526336 17126 tablet_service.cc:1467] Processing CreateTablet for tablet 77adb76eacc8458c859598c5248bf998 (DEFAULT_TABLE table=test-table [id=a6b415c85312429f836383ad599d010f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:19:05.526712 17126 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77adb76eacc8458c859598c5248bf998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:19:05.532310 17457 tablet_bootstrap.cc:492] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20: Bootstrap starting.
I20260807 20:19:05.533324 17457 tablet_bootstrap.cc:654] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20: Neither blocks nor log segments found. Creating new log.
I20260807 20:19:05.533581 17456 tablet_bootstrap.cc:492] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1: Bootstrap starting.
I20260807 20:19:05.534128 17457 log.cc:824] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20: Log is configured to *not* fsync() on all Append() calls
I20260807 20:19:05.535615 17456 tablet_bootstrap.cc:654] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1: Neither blocks nor log segments found. Creating new log.
I20260807 20:19:05.536100 17458 tablet_bootstrap.cc:492] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2: Bootstrap starting.
I20260807 20:19:05.536587 17456 log.cc:824] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1: Log is configured to *not* fsync() on all Append() calls
I20260807 20:19:05.537442 17458 tablet_bootstrap.cc:654] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2: Neither blocks nor log segments found. Creating new log.
I20260807 20:19:05.538465 17458 log.cc:824] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2: Log is configured to *not* fsync() on all Append() calls
I20260807 20:19:05.539469 17457 tablet_bootstrap.cc:492] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20: No bootstrap required, opened a new log
I20260807 20:19:05.539595 17457 ts_tablet_manager.cc:1397] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260807 20:19:05.542930 17457 raft_consensus.cc:348] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae12dd77cde942f781c50a3ef97561e1" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38065 } } peers { permanent_uuid: "ac8363d66204419bb0df25d16270ec20" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44209 } } peers { permanent_uuid: "05b606ac8d1946ea8a38e043a77904d2" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 38825 } }
I20260807 20:19:05.543251 17457 raft_consensus.cc:374] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:19:05.543362 17457 raft_consensus.cc:729] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac8363d66204419bb0df25d16270ec20, State: Initialized, Role: FOLLOWER
I20260807 20:19:05.543593 17457 consensus_queue.cc:260] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae12dd77cde942f781c50a3ef97561e1" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38065 } } peers { permanent_uuid: "ac8363d66204419bb0df25d16270ec20" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44209 } } peers { permanent_uuid: "05b606ac8d1946ea8a38e043a77904d2" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 38825 } }
I20260807 20:19:05.544018 17457 ts_tablet_manager.cc:1428] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 20:19:05.544188 17014 heartbeater.cc:503] Master 127.30.35.254:36975 was elected leader, sending a full tablet report...
I20260807 20:19:05.545862 17458 tablet_bootstrap.cc:492] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2: No bootstrap required, opened a new log
I20260807 20:19:05.546286 17456 tablet_bootstrap.cc:492] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1: No bootstrap required, opened a new log
I20260807 20:19:05.546367 17456 ts_tablet_manager.cc:1397] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.003s
I20260807 20:19:05.547827 17458 ts_tablet_manager.cc:1397] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260807 20:19:05.549316 17456 raft_consensus.cc:348] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae12dd77cde942f781c50a3ef97561e1" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38065 } } peers { permanent_uuid: "ac8363d66204419bb0df25d16270ec20" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44209 } } peers { permanent_uuid: "05b606ac8d1946ea8a38e043a77904d2" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 38825 } }
I20260807 20:19:05.551914 17458 raft_consensus.cc:348] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae12dd77cde942f781c50a3ef97561e1" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38065 } } peers { permanent_uuid: "ac8363d66204419bb0df25d16270ec20" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44209 } } peers { permanent_uuid: "05b606ac8d1946ea8a38e043a77904d2" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 38825 } }
I20260807 20:19:05.552161 17456 raft_consensus.cc:374] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:19:05.552264 17456 raft_consensus.cc:729] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae12dd77cde942f781c50a3ef97561e1, State: Initialized, Role: FOLLOWER
I20260807 20:19:05.552485 17456 consensus_queue.cc:260] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae12dd77cde942f781c50a3ef97561e1" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38065 } } peers { permanent_uuid: "ac8363d66204419bb0df25d16270ec20" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44209 } } peers { permanent_uuid: "05b606ac8d1946ea8a38e043a77904d2" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 38825 } }
I20260807 20:19:05.552893 17456 ts_tablet_manager.cc:1428] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260807 20:19:05.553072 17429 heartbeater.cc:503] Master 127.30.35.254:36975 was elected leader, sending a full tablet report...
I20260807 20:19:05.553874 17458 raft_consensus.cc:374] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:19:05.553992 17458 raft_consensus.cc:729] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05b606ac8d1946ea8a38e043a77904d2, State: Initialized, Role: FOLLOWER
I20260807 20:19:05.554194 17458 consensus_queue.cc:260] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae12dd77cde942f781c50a3ef97561e1" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38065 } } peers { permanent_uuid: "ac8363d66204419bb0df25d16270ec20" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44209 } } peers { permanent_uuid: "05b606ac8d1946ea8a38e043a77904d2" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 38825 } }
I20260807 20:19:05.554697 17458 ts_tablet_manager.cc:1428] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260807 20:19:05.554872 17234 heartbeater.cc:503] Master 127.30.35.254:36975 was elected leader, sending a full tablet report...
I20260807 20:19:05.556270 17464 raft_consensus.cc:482] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:19:05.556430 17464 raft_consensus.cc:504] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae12dd77cde942f781c50a3ef97561e1" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38065 } } peers { permanent_uuid: "ac8363d66204419bb0df25d16270ec20" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44209 } } peers { permanent_uuid: "05b606ac8d1946ea8a38e043a77904d2" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 38825 } }
I20260807 20:19:05.557602 17464 leader_election.cc:288] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae12dd77cde942f781c50a3ef97561e1 (127.30.35.195:38065), 05b606ac8d1946ea8a38e043a77904d2 (127.30.35.194:38825)
I20260807 20:19:05.566306 17455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.557171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:60765 (local address 127.30.35.195:38065)
0807 20:19:05.557214 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:05.557216 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:05.557897 (+ 681us) server_negotiation.cc:407] Connection header received
0807 20:19:05.558954 (+ 1057us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:05.558955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:05.558965 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:05.558995 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:19:05.559365 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.560115 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.564346 (+ 4231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.564908 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.564962 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.564972 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:05.566170 (+ 1198us) server_negotiation.cc:299] Negotiation successful
0807 20:19:05.566224 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 20:19:05.566836 17473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.557010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:38065 (local address 127.30.35.193:60765)
0807 20:19:05.557825 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:05.557837 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:05.558864 (+ 1027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:05.559064 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:05.559065 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:05.559067 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:19:05.559153 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:05.559155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.560581 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.560583 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:05.561886 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:05.561889 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.565037 (+ 3148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.565037 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:05.565113 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.565118 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:19:05.566677 (+ 1559us) client_negotiation.cc:240] Negotiation successful
0807 20:19:05.566740 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":796,"thread_start_us":75,"threads_started":1}
I20260807 20:19:05.567202 17452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.557546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:57063 (local address 127.30.35.194:38825)
0807 20:19:05.557582 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:05.557584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:05.559321 (+ 1737us) server_negotiation.cc:407] Connection header received
0807 20:19:05.562053 (+ 2732us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:05.562054 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:05.562065 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:05.562094 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:19:05.562307 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.562981 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.565225 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.565824 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.565877 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.565886 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:05.567087 (+ 1201us) server_negotiation.cc:299] Negotiation successful
0807 20:19:05.567135 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 20:19:05.567993 17368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77adb76eacc8458c859598c5248bf998" candidate_uuid: "ac8363d66204419bb0df25d16270ec20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae12dd77cde942f781c50a3ef97561e1" is_pre_election: true
I20260807 20:19:05.568163 17368 raft_consensus.cc:2454] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac8363d66204419bb0df25d16270ec20 in term 0.
I20260807 20:19:05.568482 16842 leader_election.cc:302] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac8363d66204419bb0df25d16270ec20, ae12dd77cde942f781c50a3ef97561e1; no voters:
I20260807 20:19:05.568711 17468 raft_consensus.cc:2781] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:19:05.568842 17468 raft_consensus.cc:482] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:19:05.568913 17468 raft_consensus.cc:3037] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:19:05.569981 17468 raft_consensus.cc:504] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae12dd77cde942f781c50a3ef97561e1" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38065 } } peers { permanent_uuid: "ac8363d66204419bb0df25d16270ec20" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44209 } } peers { permanent_uuid: "05b606ac8d1946ea8a38e043a77904d2" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 38825 } }
I20260807 20:19:05.570329 17368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77adb76eacc8458c859598c5248bf998" candidate_uuid: "ac8363d66204419bb0df25d16270ec20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae12dd77cde942f781c50a3ef97561e1"
I20260807 20:19:05.570406 17368 raft_consensus.cc:3037] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:19:05.571455 17368 raft_consensus.cc:2454] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac8363d66204419bb0df25d16270ec20 in term 1.
I20260807 20:19:05.571681 16842 leader_election.cc:302] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac8363d66204419bb0df25d16270ec20, ae12dd77cde942f781c50a3ef97561e1; no voters:
I20260807 20:19:05.571825 17464 raft_consensus.cc:2781] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:19:05.572031 17464 raft_consensus.cc:686] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [term 1 LEADER]: Becoming Leader. State: Replica: ac8363d66204419bb0df25d16270ec20, State: Running, Role: LEADER
I20260807 20:19:05.572178 17464 consensus_queue.cc:237] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae12dd77cde942f781c50a3ef97561e1" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38065 } } peers { permanent_uuid: "ac8363d66204419bb0df25d16270ec20" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44209 } } peers { permanent_uuid: "05b606ac8d1946ea8a38e043a77904d2" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 38825 } }
I20260807 20:19:05.573129 16695 catalog_manager.cc:5495] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac8363d66204419bb0df25d16270ec20 (127.30.35.193). New cstate: current_term: 1 leader_uuid: "ac8363d66204419bb0df25d16270ec20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae12dd77cde942f781c50a3ef97561e1" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac8363d66204419bb0df25d16270ec20" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 44209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05b606ac8d1946ea8a38e043a77904d2" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 38825 } health_report { overall_health: UNKNOWN } } }
I20260807 20:19:05.574214 17468 leader_election.cc:288] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [CANDIDATE]: Term 1 election: Requested vote from peers ae12dd77cde942f781c50a3ef97561e1 (127.30.35.195:38065), 05b606ac8d1946ea8a38e043a77904d2 (127.30.35.194:38825)
I20260807 20:19:05.567579 17470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.557356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:38825 (local address 127.30.35.193:57063)
0807 20:19:05.559266 (+ 1910us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:05.559276 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:05.561973 (+ 2697us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:05.562155 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:05.562156 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:05.562157 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:19:05.562232 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:05.562234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.563102 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.563103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:05.564233 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:05.564237 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.565975 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.565976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:05.566060 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.566064 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:19:05.567437 (+ 1373us) client_negotiation.cc:240] Negotiation successful
0807 20:19:05.567480 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1892,"thread_start_us":97,"threads_started":1}
I20260807 20:19:05.574783 17133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77adb76eacc8458c859598c5248bf998" candidate_uuid: "ac8363d66204419bb0df25d16270ec20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b606ac8d1946ea8a38e043a77904d2" is_pre_election: true
I20260807 20:19:05.574934 17133 raft_consensus.cc:2454] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac8363d66204419bb0df25d16270ec20 in term 0.
I20260807 20:19:05.575042 17166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77adb76eacc8458c859598c5248bf998" candidate_uuid: "ac8363d66204419bb0df25d16270ec20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05b606ac8d1946ea8a38e043a77904d2"
I20260807 20:19:05.575085 17166 raft_consensus.cc:3037] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:19:05.576037 17166 raft_consensus.cc:2454] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac8363d66204419bb0df25d16270ec20 in term 1.
I20260807 20:19:05.582343 17454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.578961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60434 (local address 127.30.35.193:44209)
0807 20:19:05.578997 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:05.579000 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:05.579009 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:19:05.579071 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:05.579072 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:05.579090 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:05.579161 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:19:05.579352 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.580099 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.581211 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:05.581501 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:05.581564 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:05.581802 (+ 238us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:19:05.581927 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:19:05.582006 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:05.582223 (+ 217us) server_negotiation.cc:299] Negotiation successful
0807 20:19:05.582245 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 20:19:05.584520 17166 raft_consensus.cc:1261] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2 [term 1 FOLLOWER]: Refusing update from remote peer ac8363d66204419bb0df25d16270ec20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:19:05.584964 17474 consensus_queue.cc:1035] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05b606ac8d1946ea8a38e043a77904d2" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 38825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:19:05.587350 17368 raft_consensus.cc:1261] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1 [term 1 FOLLOWER]: Refusing update from remote peer ac8363d66204419bb0df25d16270ec20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:19:05.587713 17474 consensus_queue.cc:1035] T 77adb76eacc8458c859598c5248bf998 P ac8363d66204419bb0df25d16270ec20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae12dd77cde942f781c50a3ef97561e1" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 38065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:19:05.592263 17478 mvcc.cc:205] Tried to move back new op lower bound from 7316004641111228416 to 7316004641064706048. Current Snapshot: MvccSnapshot[applied={T|T < 7316004641111228416}]
I20260807 20:19:05.594684 17481 mvcc.cc:205] Tried to move back new op lower bound from 7316004641111228416 to 7316004641064706048. Current Snapshot: MvccSnapshot[applied={T|T < 7316004641111228416}]
I20260807 20:19:05.594942 17479 mvcc.cc:205] Tried to move back new op lower bound from 7316004641111228416 to 7316004641064706048. Current Snapshot: MvccSnapshot[applied={T|T < 7316004641111228416}]
I20260807 20:19:05.597450 16695 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57696:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:19:05.597537 16695 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57696:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:19:05.598345 16695 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fd15c1c8574547f0b843d051a5978a4e: Sending DeleteTablet for 3 replicas of tablet 77adb76eacc8458c859598c5248bf998
I20260807 20:19:05.598785 17339 tablet_service.cc:1514] Processing DeleteTablet for tablet 77adb76eacc8458c859598c5248bf998 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:19:05 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:47784
I20260807 20:19:05.598995 16912 tablet_service.cc:1514] Processing DeleteTablet for tablet 77adb76eacc8458c859598c5248bf998 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:19:05 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:60428
I20260807 20:19:05.599390 17126 tablet_service.cc:1514] Processing DeleteTablet for tablet 77adb76eacc8458c859598c5248bf998 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:19:05 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:49048
I20260807 20:19:05.600031 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 16818
I20260807 20:19:05.611104 17489 tablet_replica.cc:330] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1: stopping tablet replica
I20260807 20:19:05.611370 17489 raft_consensus.cc:2229] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:19:05.611763 17489 raft_consensus.cc:2258] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:19:05.615509 17491 tablet_replica.cc:330] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2: stopping tablet replica
I20260807 20:19:05.615705 17491 raft_consensus.cc:2229] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:19:05.616228 17491 raft_consensus.cc:2258] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:19:05.616933 17491 ts_tablet_manager.cc:1905] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:19:05.617614 17489 ts_tablet_manager.cc:1905] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:19:05.619329 17489 ts_tablet_manager.cc:1918] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:19:05.619472 17489 log.cc:1196] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/77adb76eacc8458c859598c5248bf998
I20260807 20:19:05.620123 17489 ts_tablet_manager.cc:1939] T 77adb76eacc8458c859598c5248bf998 P ae12dd77cde942f781c50a3ef97561e1: Deleting consensus metadata
I20260807 20:19:05.624063 17491 ts_tablet_manager.cc:1918] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:19:05.624151 17491 log.cc:1196] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/77adb76eacc8458c859598c5248bf998
I20260807 20:19:05.624408 17491 ts_tablet_manager.cc:1939] T 77adb76eacc8458c859598c5248bf998 P 05b606ac8d1946ea8a38e043a77904d2: Deleting consensus metadata
I20260807 20:19:05.624897 16669 catalog_manager.cc:4841] TS 05b606ac8d1946ea8a38e043a77904d2 (127.30.35.194:38825): tablet 77adb76eacc8458c859598c5248bf998 (table test-table [id=a6b415c85312429f836383ad599d010f]) successfully deleted
I20260807 20:19:05.625464 16670 catalog_manager.cc:4841] TS ae12dd77cde942f781c50a3ef97561e1 (127.30.35.195:38065): tablet 77adb76eacc8458c859598c5248bf998 (table test-table [id=a6b415c85312429f836383ad599d010f]) successfully deleted
W20260807 20:19:05.625991 16670 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:44209 (error 108)
I20260807 20:19:05.626626 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 17025
I20260807 20:19:05.638407 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.637978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:44209 (local address 127.0.0.1:60444)
0807 20:19:05.638316 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:05.638364 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:44209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317}
W20260807 20:19:05.638707 16670 catalog_manager.cc:4584] TS ac8363d66204419bb0df25d16270ec20 (127.30.35.193:44209): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 77adb76eacc8458c859598c5248bf998: Network error: Client connection negotiation failed: client connection to 127.30.35.193:44209: connect: Connection refused (error 111)
I20260807 20:19:05.653241 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 17240
Aug 07 20:19:05 dist-test-slave-t7g5 krb5kdc[15993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133945, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:05.725382 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.725219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:44209 (local address 127.0.0.1:60458)
0807 20:19:05.725291 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:05.725324 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:44209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 20:19:05.727376 17453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:05.727272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:44209 (local address 127.0.0.1:60460)
0807 20:19:05.727316 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:05.727341 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:44209: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 20:19:05.732210 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 16647
I20260807 20:19:05.743600 30863 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 20:19:06.089558 30863 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 20:19:06.089704 30863 mini_ranger.cc:66] Stopping Ranger...
I20260807 20:19:06.433319 30863 mini_ranger.cc:68] Stopped Ranger
2026-08-07 20:19:06.433 UTC [16033] LOG: received smart shutdown request
2026-08-07 20:19:06.437 UTC [16033] LOG: background worker "logical replication launcher" (PID 16044) exited with exit code 1
2026-08-07 20:19:06.437 UTC [16037] LOG: shutting down
2026-08-07 20:19:06.583 UTC [16033] LOG: database system is shut down
2026-08-07T20:19:06Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (45717 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:19:06 dist-test-slave-t7g5 krb5kdc[17508](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:19:06 dist-test-slave-t7g5 krb5kdc[17508](info): set up 2 sockets
Aug 07 20:19:06 dist-test-slave-t7g5 krb5kdc[17508](info): commencing operation
krb5kdc: starting...
W20260807 20:19:07.805894 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:19:07 dist-test-slave-t7g5 krb5kdc[17508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133947, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:19:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:19:07Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.30.35.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.30.35.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/rangeradmin_127.30.35.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/rangeradmin_127.30.35.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.30.35.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.30.35.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/rangerlookup_127.30.35.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/rangerlookup_127.30.35.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.35.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.30.35.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/HTTP_127.30.35.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/HTTP_127.30.35.212@KRBTEST.COM.keytab.
I20260807 20:19:07.965116 30863 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskX5HdRu/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/postgres -l logfile start
2026-08-07 20:19:10.213 UTC [17563] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 20:19:10.213 UTC [17563] LOG: listening on IPv4 address "127.30.35.212", port 52465
2026-08-07 20:19:10.216 UTC [17563] LOG: listening on Unix socket "/tmp/.s.PGSQL.52465"
2026-08-07 20:19:10.236 UTC [17566] LOG: database system was shut down at 2026-08-07 20:19:08 UTC
2026-08-07 20:19:10.239 UTC [17563] LOG: database system is ready to accept connections
I20260807 20:19:11.293946 30863 mini_postgres.cc:96] Postgres bound to 52465
2026-08-07 20:19:11.300 UTC [17576] FATAL: database "slave" does not exist
127.30.35.212:52465 - accepting connections
I20260807 20:19:11.301374 30863 mini_ranger.cc:161] Starting Ranger...
I20260807 20:19:11.315447 30863 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 20:19:11.715708 30863 mini_ranger.cc:87] Created ranger Postgres database
I20260807 20:19:11.715786 30863 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-admin
2026-08-07 20:19:11,982 [I] DB FLAVOR :POSTGRES
2026-08-07 20:19:11,983 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 20:19:11,983 [I] Checking connection..
2026-08-07 20:19:11,983 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 20:19:12,234 [I] Checking connection passed.
2026-08-07 20:19:12,234 [I] --------- Verifying version history table ---------
2026-08-07 20:19:12,235 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 20:19:12,474 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 20:19:12,474 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 20:19:12,708 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 20:19:12,709 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 20:19:12,709 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 20:19:12.961 UTC [17670] WARNING: there is no transaction in progress
2026-08-07 20:19:12,969 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 20:19:12,970 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 20:19:13,215 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 20:19:13,215 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 20:19:13,215 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 20:19:13,457 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 20:19:13,717 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-t7g5.c.gcp-upstream.internal','N') ;"
2026-08-07 20:19:13,971 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 20:19:14,228 [I] Table x_portal_user does not exist in database ranger
2026-08-07 20:19:14,228 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 20:19:14,467 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 20:19:14,468 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 20:19:14,696 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 20:19:14,957 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 20:19:14,957 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 20:19:15.835 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:15.849 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:15.864 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:15.878 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:15.894 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:15.919 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:15.969 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:15.975 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:15.989 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:15.998 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:16.008 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:16.020 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:16.029 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:16.035 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:16.041 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:16.047 UTC [17830] WARNING: there is no transaction in progress
2026-08-07 20:19:16,605 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 20:19:16,606 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 20:19:16,850 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 20:19:16,851 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 20:19:17,097 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 20:19:17,097 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 20:19:17,324 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 20:19:17,325 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 20:19:17,578 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 20:19:17,836 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-t7g5.c.gcp-upstream.internal';"
2026-08-07 20:19:18,078 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 20:19:18,078 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 20:19:18,327 [I] DB_PATCHES have already been applied
I20260807 20:19:18.333446 30863 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-admin:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskX5HdRu/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 20:19:18.333509 30863 mini_ranger.cc:193] Using host: 127.30.35.212
I20260807 20:19:18.337127 30863 mini_ranger.cc:227] Ranger admin URL: http://127.30.35.212:43503
Aug 07, 2026 8:19:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 8:19:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 8:19:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 8:19:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 8:19:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 8:19:19 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 8:19:19 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 20:19:19.558588 30863 mini_ranger.cc:160] Time spent starting Ranger: real 8.257s user 0.000s sys 0.009s
Aug 07, 2026 8:19:39 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 8:19:39 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 8:19:39 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 8:19:39 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 8:19:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 8:19:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 8:19:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 8:19:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 8:19:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 8:19:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 8:19:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 8:19:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 8:19:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 8:19:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 8:19:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 8:19:39 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 8:19:39 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 8:19:40 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 20:19:40.857877 30863 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.30.35.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.30.35.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/rangerkms_127.30.35.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.30.35.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/rangerkms_127.30.35.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.30.35.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.30.35.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.30.35.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/HTTP_127.30.35.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.30.35.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/HTTP_127.30.35.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 20:19:40 dist-test-slave-t7g5 krb5kdc[17508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133980, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 20:19:40.966238 30863 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 20:19:40.976326 30863 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 20:19:41.740217 30863 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 20:19:41.740304 30863 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-kms
I20260807 20:19:41.740321 30863 mini_ranger_kms.cc:227] Using postgres at 127.30.35.212:52465
2026-08-07 20:19:41,903 [I] DB FLAVOR :POSTGRES
2026-08-07 20:19:41,903 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 20:19:41,904 [I] Checking connection
2026-08-07 20:19:41,904 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 20:19:42,142 [I] connection success
2026-08-07 20:19:42,143 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 20:19:42,143 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 20:19:42,143 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 20:19:42,400 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 20:19:42,401 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 20:19:42,401 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 20:19:42,401 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.30.35.212:52465/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 20:19:42,677 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 20:19:43.115219 30863 mini_ranger_kms.cc:310] Created kms service
I20260807 20:19:43.270996 30863 mini_ranger_kms.cc:326] Created kudu user
I20260807 20:19:43.311028 30863 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 20:19:43 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133980, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:43.672058 30863 mini_ranger_kms.cc:384] Added ranger policy
I20260807 20:19:43.672175 30863 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-kms:/tmp/dist-test-taskX5HdRu/build/release/bin/postgresql.jar:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskX5HdRu/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 20:19:43.672191 30863 mini_ranger_kms.cc:240] Using host: 127.30.35.212
I20260807 20:19:43.675964 30863 mini_ranger_kms.cc:276] Ranger KMS PID: 18097
I20260807 20:19:43.676036 30863 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.30.35.212:38555
Aug 07, 2026 8:19:44 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 8:19:44 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 8:19:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 8:19:44 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 8:19:45 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 8:19:45 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 20:19:45 dist-test-slave-t7g5 krb5kdc[17508](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786133985, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.35.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:46.086975 30863 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.121s user 0.006s sys 0.140s
I20260807 20:19:46.087059 30863 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 20:19:46.087095 30863 mini_ranger_kms.cc:401] 127.30.35.212:38555/kms/v1/keys
Aug 07 20:19:46 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133985, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.35.212@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
Aug 07 20:19:46 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133985, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.30.35.212@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
Aug 07 20:19:48 dist-test-slave-t7g5 krb5kdc[17508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:19:48.995857 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:33499
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:33499
--ranger_config_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.35.212:38555/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:19:49.103286 18179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:49.103498 18179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:49.103528 18179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:49.104671 18179 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:19:49.104713 18179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:49.104732 18179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:49.104748 18179 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:19:49.104763 18179 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:19:49.106379 18179 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/wal
--ranger_kms_url=127.30.35.212:38555/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:33499
--ranger_config_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:33499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:49.106621 18179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:49.106812 18179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:49.111737 18194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:49.111743 18186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:49.111743 18187 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:49.111862 18179 server_base.cc:1034] running on GCE node
I20260807 20:19:49.112285 18179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:49.112587 18179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:49.113710 18179 hybrid_clock.cc:648] HybridClock initialized: now 1786133989113692 us; error 34 us; skew 500 ppm
Aug 07 20:19:49 dist-test-slave-t7g5 krb5kdc[17508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133989, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:49.119187 18179 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:19:49.119642 18179 webserver.cc:460] Webserver started at http://127.30.35.254:38867/ using document root <none> and password file <none>
I20260807 20:19:49.119864 18179 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:49.119903 18179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:49.120043 18179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 20:19:49 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133989, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:49.173511 18179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "8fe6199b4be642cd848e67301a312a99"
format_stamp: "Formatted at 2026-08-07 20:19:49 on dist-test-slave-t7g5"
server_key: "1b8789030d595e85687cb41ed473bb3c"
server_key_iv: "54da5e2162105fcacf490af3c449f0e0"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:49.174063 18179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "8fe6199b4be642cd848e67301a312a99"
format_stamp: "Formatted at 2026-08-07 20:19:49 on dist-test-slave-t7g5"
server_key: "1b8789030d595e85687cb41ed473bb3c"
server_key_iv: "54da5e2162105fcacf490af3c449f0e0"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:49.175585 18179 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:19:49.187891 18204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:49.188134 18179 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 20:19:49.188264 18179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "8fe6199b4be642cd848e67301a312a99"
format_stamp: "Formatted at 2026-08-07 20:19:49 on dist-test-slave-t7g5"
server_key: "1b8789030d595e85687cb41ed473bb3c"
server_key_iv: "54da5e2162105fcacf490af3c449f0e0"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:49.188369 18179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:49.217398 18179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:49.219017 18179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:49.219161 18179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:49.223142 18179 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:33499
I20260807 20:19:49.223201 18270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:33499 every 8 connection(s)
I20260807 20:19:49.223533 18179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:19:49.224169 18273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:19:49.226445 18273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99: Bootstrap starting.
I20260807 20:19:49.226991 18273 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99: Neither blocks nor log segments found. Creating new log.
I20260807 20:19:49.227255 18273 log.cc:824] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99: Log is configured to *not* fsync() on all Append() calls
I20260807 20:19:49.227936 18273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99: No bootstrap required, opened a new log
I20260807 20:19:49.229905 18273 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe6199b4be642cd848e67301a312a99" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33499 } }
I20260807 20:19:49.230054 18273 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:19:49.230086 18273 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe6199b4be642cd848e67301a312a99, State: Initialized, Role: FOLLOWER
I20260807 20:19:49.230217 18273 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe6199b4be642cd848e67301a312a99" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33499 } }
I20260807 20:19:49.230294 18273 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:19:49.230325 18273 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:19:49.230372 18273 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:19:49.230877 18273 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe6199b4be642cd848e67301a312a99" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33499 } }
I20260807 20:19:49.230971 18273 leader_election.cc:302] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fe6199b4be642cd848e67301a312a99; no voters:
I20260807 20:19:49.231132 18273 leader_election.cc:288] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:19:49.231177 18276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:19:49.231364 18276 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 1 LEADER]: Becoming Leader. State: Replica: 8fe6199b4be642cd848e67301a312a99, State: Running, Role: LEADER
I20260807 20:19:49.231370 18273 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:19:49.231478 18276 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe6199b4be642cd848e67301a312a99" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33499 } }
I20260807 20:19:49.231809 18278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe6199b4be642cd848e67301a312a99. Latest consensus state: current_term: 1 leader_uuid: "8fe6199b4be642cd848e67301a312a99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe6199b4be642cd848e67301a312a99" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33499 } } }
I20260807 20:19:49.231817 18277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8fe6199b4be642cd848e67301a312a99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe6199b4be642cd848e67301a312a99" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33499 } } }
I20260807 20:19:49.231949 18278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [sys.catalog]: This master's current role is: LEADER
I20260807 20:19:49.231997 18277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [sys.catalog]: This master's current role is: LEADER
I20260807 20:19:49.232172 18287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:19:49.232312 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 18179
I20260807 20:19:49.232429 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:19:49.232621 30863 external_mini_cluster.cc:1428] Setting key 31ada329277374af42569e34fe599116
I20260807 20:19:49.232712 18287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:19:49.233023 18273 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 20:19:49.238602 18287 catalog_manager.cc:1347] Generated new cluster ID: 5160ac2aa4d14acbbace4ab4ea75ec8a
I20260807 20:19:49.238734 18287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:19:49 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133988, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:49.246347 18303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:49.233069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42704 (local address 127.30.35.254:33499)
0807 20:19:49.233242 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:49.233251 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:49.233285 (+ 34us) server_negotiation.cc:407] Connection header received
0807 20:19:49.233420 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:49.233428 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:49.233489 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:49.234943 (+ 1454us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:49.235472 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:49.237231 (+ 1759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:49.238198 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:49.238794 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:49.242054 (+ 3260us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:49.242152 (+ 98us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:49.242155 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:49.242156 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:49.242165 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:49.244191 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:49.244596 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:49.244599 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:49.244600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:49.244709 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:49.244939 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:49.244940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:49.244940 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:49.245264 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:49.245871 (+ 607us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:49.245985 (+ 114us) server_negotiation.cc:299] Negotiation successful
0807 20:19:49.246112 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
I20260807 20:19:49.264906 18287 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:19:49.265679 18287 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:19:49.270979 18287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99: Generated new TSK 0
I20260807 20:19:49.271159 18287 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:19:49.932317 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.35.212:38555/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33499
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:19:50.033600 18337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:50.033914 18337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:50.033951 18337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:50.035159 18337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:50.035204 18337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:50.035230 18337 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:19:50.036712 18337 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.30.35.212:38555/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:50.036935 18337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:50.037158 18337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:50.042054 18346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:50.042158 18352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:50.042052 18348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:50.042939 18337 server_base.cc:1034] running on GCE node
I20260807 20:19:50.043141 18337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:50.043363 18337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:50.044529 18337 hybrid_clock.cc:648] HybridClock initialized: now 1786133990044510 us; error 32 us; skew 500 ppm
Aug 07 20:19:50 dist-test-slave-t7g5 krb5kdc[17508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133990, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:50.047936 18337 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:19:50.048470 18337 webserver.cc:460] Webserver started at http://127.30.35.193:44329/ using document root <none> and password file <none>
I20260807 20:19:50.048738 18337 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:50.048794 18337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:50.048967 18337 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 20:19:50 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133990, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:50.062754 18337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "52010c1f2be8460db569ec2d247cbeec"
format_stamp: "Formatted at 2026-08-07 20:19:50 on dist-test-slave-t7g5"
server_key: "4ca691f052e2bf182d6a50882de11dc7"
server_key_iv: "f92df5a31ae8dbe6a798e580e5974730"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:50.063326 18337 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "52010c1f2be8460db569ec2d247cbeec"
format_stamp: "Formatted at 2026-08-07 20:19:50 on dist-test-slave-t7g5"
server_key: "4ca691f052e2bf182d6a50882de11dc7"
server_key_iv: "f92df5a31ae8dbe6a798e580e5974730"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:50.065256 18337 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260807 20:19:50.080845 18365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:50.081087 18337 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:19:50.081183 18337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "52010c1f2be8460db569ec2d247cbeec"
format_stamp: "Formatted at 2026-08-07 20:19:50 on dist-test-slave-t7g5"
server_key: "4ca691f052e2bf182d6a50882de11dc7"
server_key_iv: "f92df5a31ae8dbe6a798e580e5974730"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:50.081290 18337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:50.105563 18337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:50.107978 18337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:50.108135 18337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:50.108393 18337 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:19:50.108771 18337 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:19:50.108896 18337 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:50.108964 18337 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:19:50.108999 18337 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:50.116335 18337 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:36703
I20260807 20:19:50.116420 18559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:36703 every 8 connection(s)
I20260807 20:19:50.116848 18337 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:19:50.118331 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 18337
I20260807 20:19:50.118448 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:19:50.118649 30863 external_mini_cluster.cc:1428] Setting key 668cbbda78c8953207407aa207cb37ed
Aug 07 20:19:50 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133990, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:50.131332 18563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:50.117804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:35193 (local address 127.30.35.254:33499)
0807 20:19:50.118952 (+ 1148us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:50.118955 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:50.121080 (+ 2125us) server_negotiation.cc:407] Connection header received
0807 20:19:50.121711 (+ 631us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:50.121712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:50.121726 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:50.121795 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:50.122692 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:50.123474 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:50.124979 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:50.125291 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:50.125359 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:50.128089 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:50.128091 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:50.128091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:50.128099 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:50.129836 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:50.130299 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:50.130301 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:50.130301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:50.130364 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:50.130627 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:50.130628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:50.130628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:50.130760 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:50.130798 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:50.131153 (+ 355us) server_negotiation.cc:299] Negotiation successful
0807 20:19:50.131239 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1110,"thread_start_us":79,"threads_started":1}
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
I20260807 20:19:50.132082 18562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:50.117592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33499 (local address 127.30.35.193:35193)
0807 20:19:50.119020 (+ 1428us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:50.119068 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:50.121521 (+ 2453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:50.122050 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:50.122055 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:50.122296 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:50.122588 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:50.122595 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:50.123596 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:50.123598 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:50.124877 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:50.124880 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:50.125454 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:50.125455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:50.125599 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:50.126272 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:50.126282 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:50.127978 (+ 1696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:50.129927 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:50.129934 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:50.129936 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:50.130213 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:50.130437 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:50.130438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:50.130438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:50.130562 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:50.130839 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:50.130844 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:50.131003 (+ 159us) client_negotiation.cc:769] Sending connection context
0807 20:19:50.131691 (+ 688us) client_negotiation.cc:240] Negotiation successful
0807 20:19:50.131853 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1384,"thread_start_us":313,"threads_started":1}
I20260807 20:19:50.132836 18560 heartbeater.cc:347] Connected to a master server at 127.30.35.254:33499
I20260807 20:19:50.133076 18560 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:50.133279 18560 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
I20260807 20:19:50.133953 18222 ts_manager.cc:194] Registered new tserver with Master: 52010c1f2be8460db569ec2d247cbeec (127.30.35.193:36703)
I20260807 20:19:50.134960 18222 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:35193
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:19:50.152915 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.35.212:38555/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33499
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:19:50.278940 18566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:50.279218 18566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:50.279256 18566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:50.280447 18566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:50.280498 18566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:50.280536 18566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:19:50.285832 18566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.30.35.212:38555/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:50.286388 18566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:50.286749 18566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:50.293807 18579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:50.294339 18581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:50.294592 18577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:50.295703 18566 server_base.cc:1034] running on GCE node
I20260807 20:19:50.295910 18566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:50.296196 18566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:50.297371 18566 hybrid_clock.cc:648] HybridClock initialized: now 1786133990297347 us; error 40 us; skew 500 ppm
Aug 07 20:19:50 dist-test-slave-t7g5 krb5kdc[17508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133990, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:50.300639 18566 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:19:50.301154 18566 webserver.cc:460] Webserver started at http://127.30.35.194:36001/ using document root <none> and password file <none>
I20260807 20:19:50.301435 18566 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:50.301496 18566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:50.301627 18566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 20:19:50 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133990, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:50.320544 18566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "e810c6651ff74fc5952071c5f4792d31"
format_stamp: "Formatted at 2026-08-07 20:19:50 on dist-test-slave-t7g5"
server_key: "3310c6e01e84f58c543d73279f9bf521"
server_key_iv: "78e3683bdf40ba34e1d5da3583a14eb4"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:50.321115 18566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "e810c6651ff74fc5952071c5f4792d31"
format_stamp: "Formatted at 2026-08-07 20:19:50 on dist-test-slave-t7g5"
server_key: "3310c6e01e84f58c543d73279f9bf521"
server_key_iv: "78e3683bdf40ba34e1d5da3583a14eb4"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:50.325806 18566 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.002s
Aug 07 20:19:50 dist-test-slave-t7g5 krb5kdc[17508](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786133990, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:50.340566 18595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:50.340799 18566 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:19:50.340893 18566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "e810c6651ff74fc5952071c5f4792d31"
format_stamp: "Formatted at 2026-08-07 20:19:50 on dist-test-slave-t7g5"
server_key: "3310c6e01e84f58c543d73279f9bf521"
server_key_iv: "78e3683bdf40ba34e1d5da3583a14eb4"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:50.340969 18566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:50.354110 18566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:50.356523 18566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:50.356731 18566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:50.356986 18566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:19:50.357395 18566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:19:50.357487 18566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:50.357559 18566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:19:50.357614 18566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:50.364130 18566 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:40763
I20260807 20:19:50.364640 18566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:19:50.366567 18756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:40763 every 8 connection(s)
I20260807 20:19:50.370815 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 18566
I20260807 20:19:50.370935 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:19:50.371143 30863 external_mini_cluster.cc:1428] Setting key 193aecca34aedfa67e17590db5b1df0b
Aug 07 20:19:50 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133990, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:50.381892 18563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:50.368121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:59377 (local address 127.30.35.254:33499)
0807 20:19:50.368179 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:50.368181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:50.368544 (+ 363us) server_negotiation.cc:407] Connection header received
0807 20:19:50.369371 (+ 827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:50.369373 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:50.369388 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:50.369417 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:50.370313 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:50.371110 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:50.375514 (+ 4404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:50.375850 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:50.375896 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:50.378566 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:50.378568 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:50.378568 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:50.378576 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:50.380197 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:50.380690 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:50.380691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:50.380692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:50.380767 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:50.381065 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:50.381066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:50.381066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:50.381223 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:50.381278 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:50.381688 (+ 410us) server_negotiation.cc:299] Negotiation successful
0807 20:19:50.381798 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 20:19:50.382652 18764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:50.367810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33499 (local address 127.30.35.194:59377)
0807 20:19:50.368404 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:50.368454 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:50.369240 (+ 786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:50.369604 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:50.369609 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:50.369908 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:50.370197 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:50.370204 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:50.374012 (+ 3808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:50.374013 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:50.375376 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:50.375380 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:50.376005 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:50.376006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:50.376154 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:50.376761 (+ 607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:50.376772 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:50.378456 (+ 1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:50.380296 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:50.380303 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:50.380306 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:50.380599 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:50.380834 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:50.380834 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:50.380835 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:50.380981 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:50.381314 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:50.381322 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:50.381489 (+ 167us) client_negotiation.cc:769] Sending connection context
0807 20:19:50.382239 (+ 750us) client_negotiation.cc:240] Negotiation successful
0807 20:19:50.382411 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":94,"threads_started":1}
I20260807 20:19:50.383420 18760 heartbeater.cc:347] Connected to a master server at 127.30.35.254:33499
I20260807 20:19:50.383519 18760 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:50.383710 18760 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
I20260807 20:19:50.384136 18222 ts_manager.cc:194] Registered new tserver with Master: e810c6651ff74fc5952071c5f4792d31 (127.30.35.194:40763)
I20260807 20:19:50.384621 18222 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:59377
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:19:50.423221 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.35.212:38555/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33499
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:19:50.547075 18769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:50.547425 18769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:50.547510 18769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:50.549255 18769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:50.549373 18769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:50.549456 18769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:19:50.551683 18769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.30.35.212:38555/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:50.552177 18769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:50.552510 18769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:50.559227 18779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:50.559499 18776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:50.560333 18777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:50.560534 18769 server_base.cc:1034] running on GCE node
I20260807 20:19:50.560746 18769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:50.561004 18769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:50.562158 18769 hybrid_clock.cc:648] HybridClock initialized: now 1786133990562137 us; error 35 us; skew 500 ppm
Aug 07 20:19:50 dist-test-slave-t7g5 krb5kdc[17508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133990, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:50.565548 18769 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:19:50.566123 18769 webserver.cc:460] Webserver started at http://127.30.35.195:33783/ using document root <none> and password file <none>
I20260807 20:19:50.566404 18769 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:50.566461 18769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:50.566593 18769 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 20:19:50 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133990, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:50.589948 18769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "5ba5fc62b92b40b6be89d6608ca408ce"
format_stamp: "Formatted at 2026-08-07 20:19:50 on dist-test-slave-t7g5"
server_key: "f06c1bd7c67c05150461b68629aab0dc"
server_key_iv: "35e78f5d5766557d28dbbf7b7c54f9d8"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:50.590574 18769 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "5ba5fc62b92b40b6be89d6608ca408ce"
format_stamp: "Formatted at 2026-08-07 20:19:50 on dist-test-slave-t7g5"
server_key: "f06c1bd7c67c05150461b68629aab0dc"
server_key_iv: "35e78f5d5766557d28dbbf7b7c54f9d8"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:50.594033 18769 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260807 20:19:50.614326 18792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:50.614589 18769 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 20:19:50.614742 18769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "5ba5fc62b92b40b6be89d6608ca408ce"
format_stamp: "Formatted at 2026-08-07 20:19:50 on dist-test-slave-t7g5"
server_key: "f06c1bd7c67c05150461b68629aab0dc"
server_key_iv: "35e78f5d5766557d28dbbf7b7c54f9d8"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:50.614918 18769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:50.661253 18769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:50.663507 18769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:50.663661 18769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:50.663894 18769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:19:50.664331 18769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:19:50.664382 18769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:50.664414 18769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:19:50.664472 18769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:50.671587 18769 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:39991
I20260807 20:19:50.672046 18769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:19:50.672379 18970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:39991 every 8 connection(s)
Aug 07 20:19:50 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133990, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:50.680015 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 18769
I20260807 20:19:50.680133 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:19:50.680346 30863 external_mini_cluster.cc:1428] Setting key da4631fdec562f3f2e4b9cac03809af6
I20260807 20:19:50.683530 18563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:50.673129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:48773 (local address 127.30.35.254:33499)
0807 20:19:50.673180 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:50.673182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:50.673290 (+ 108us) server_negotiation.cc:407] Connection header received
0807 20:19:50.674066 (+ 776us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:50.674068 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:50.674080 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:50.674136 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:50.674889 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:50.675602 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:50.677054 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:50.677334 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:50.677406 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:50.680513 (+ 3107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:50.680515 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:50.680516 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:50.680524 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:50.682093 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:50.682538 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:50.682540 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:50.682540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:50.682601 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:50.682868 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:50.682869 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:50.682869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:50.683000 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:50.683066 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:50.683362 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 20:19:50.683441 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 20:19:50.683938 18976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:50.672794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33499 (local address 127.30.35.195:48773)
0807 20:19:50.673145 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:50.673194 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:50.673927 (+ 733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:50.674219 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:50.674223 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:50.674479 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:50.674792 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:50.674798 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:50.675708 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:50.675709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:50.676960 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:50.676963 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:50.677429 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:50.677430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:50.677568 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:50.678146 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:50.678157 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:50.679752 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:50.682176 (+ 2424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:50.682183 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:50.682186 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:50.682467 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:50.682661 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:50.682662 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:50.682662 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:50.682801 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:50.683061 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:50.683066 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:50.683219 (+ 153us) client_negotiation.cc:769] Sending connection context
0807 20:19:50.683332 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 20:19:50.683490 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":95,"threads_started":1}
I20260807 20:19:50.684450 18973 heartbeater.cc:347] Connected to a master server at 127.30.35.254:33499
I20260807 20:19:50.684556 18973 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:50.684767 18973 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
I20260807 20:19:50.685221 18222 ts_manager.cc:194] Registered new tserver with Master: 5ba5fc62b92b40b6be89d6608ca408ce (127.30.35.195:39991)
I20260807 20:19:50.685742 18222 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:48773
I20260807 20:19:50.698989 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:19:50.699703 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 18337
I20260807 20:19:50.718564 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 18566
I20260807 20:19:50.727257 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 18769
I20260807 20:19:50.744071 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 18179
I20260807 20:19:50.755492 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:33499
--webserver_interface=127.30.35.254
--webserver_port=38867
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:33499
--ranger_config_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.35.212:38555/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.35.212:38555/kms with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:19:50.837311 18977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:50.837530 18977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:50.837561 18977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:50.838709 18977 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:19:50.838763 18977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:50.838784 18977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:50.838800 18977 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:19:50.838822 18977 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:19:50.840348 18977 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.35.212:38555/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:33499
--ranger_config_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:33499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=38867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:50.840582 18977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:50.840790 18977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 20:19:50.845341 18977 server_base.cc:1034] running on GCE node
W20260807 20:19:50.845325 18983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:50.845304 18986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:50.845278 18989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:50.845796 18977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:50.846074 18977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:50.847222 18977 hybrid_clock.cc:648] HybridClock initialized: now 1786133990847208 us; error 32 us; skew 500 ppm
Aug 07 20:19:50 dist-test-slave-t7g5 krb5kdc[17508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133990, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:50.855157 18977 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:19:50.855612 18977 webserver.cc:460] Webserver started at http://127.30.35.254:38867/ using document root <none> and password file <none>
I20260807 20:19:50.855819 18977 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:50.855871 18977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 20:19:50 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133990, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:50.895673 18977 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:19:50.896364 19001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:50.896535 18977 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:19:50.896626 18977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "8fe6199b4be642cd848e67301a312a99"
format_stamp: "Formatted at 2026-08-07 20:19:49 on dist-test-slave-t7g5"
server_key: "1b8789030d595e85687cb41ed473bb3c"
server_key_iv: "54da5e2162105fcacf490af3c449f0e0"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:50.897004 18977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:50.915446 18977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:50.917362 18977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:50.917505 18977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:50.922041 18977 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:33499
I20260807 20:19:50.922094 19077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:33499 every 8 connection(s)
I20260807 20:19:50.922468 18977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:19:50.923694 19078 sys_catalog.cc:263] Verifying existing consensus state
I20260807 20:19:50.924418 19078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99: Bootstrap starting.
I20260807 20:19:50.932235 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 18977
I20260807 20:19:50.932610 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.35.212:38555/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:36703
--local_ip_for_outbound_sockets=127.30.35.193
--tserver_master_addrs=127.30.35.254:33499
--webserver_port=44329
--webserver_interface=127.30.35.193
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.35.212:38555/kms with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:19:50.934527 19078 log.cc:824] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99: Log is configured to *not* fsync() on all Append() calls
I20260807 20:19:50.937064 19078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 20:19:50.937481 19078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99: Bootstrap complete.
I20260807 20:19:50.941219 19078 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe6199b4be642cd848e67301a312a99" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33499 } }
I20260807 20:19:50.941679 19078 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe6199b4be642cd848e67301a312a99, State: Initialized, Role: FOLLOWER
I20260807 20:19:50.942025 19078 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe6199b4be642cd848e67301a312a99" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33499 } }
I20260807 20:19:50.942207 19078 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:19:50.942322 19078 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:19:50.942433 19078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 1 FOLLOWER]: Advancing to term 2
I20260807 20:19:50.943895 19078 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe6199b4be642cd848e67301a312a99" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33499 } }
I20260807 20:19:50.944096 19078 leader_election.cc:302] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fe6199b4be642cd848e67301a312a99; no voters:
I20260807 20:19:50.944324 19078 leader_election.cc:288] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 20:19:50.944645 19078 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:19:50.946233 19078 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 20:19:50.947954 19088 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 20:19:50.948096 19088 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [term 2 LEADER]: Becoming Leader. State: Replica: 8fe6199b4be642cd848e67301a312a99, State: Running, Role: LEADER
I20260807 20:19:50.948199 19088 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe6199b4be642cd848e67301a312a99" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33499 } }
I20260807 20:19:50.948451 19088 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe6199b4be642cd848e67301a312a99. Latest consensus state: current_term: 2 leader_uuid: "8fe6199b4be642cd848e67301a312a99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe6199b4be642cd848e67301a312a99" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33499 } } }
I20260807 20:19:50.948545 19088 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [sys.catalog]: This master's current role is: LEADER
I20260807 20:19:50.948451 19106 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8fe6199b4be642cd848e67301a312a99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fe6199b4be642cd848e67301a312a99" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 33499 } } }
I20260807 20:19:50.948673 19106 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99 [sys.catalog]: This master's current role is: LEADER
I20260807 20:19:50.952121 19110 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:19:50.952656 19110 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:19:50.952790 19110 catalog_manager.cc:1259] Loaded cluster ID: 5160ac2aa4d14acbbace4ab4ea75ec8a
I20260807 20:19:50.952821 19110 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:19:50.954200 19110 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:19:50.954392 19110 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99: Loaded TSK: 0
I20260807 20:19:50.954633 19110 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 20:19:51.052747 19080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:51.053040 19080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:51.053082 19080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:51.054807 19080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:51.054867 19080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:51.054908 19080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:19:51.057076 19080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.35.212:38555/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:36703
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=44329
--tserver_master_addrs=127.30.35.254:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:51.057471 19080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:51.057750 19080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:51.064091 19135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:51.064514 19138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:51.064620 19080 server_base.cc:1034] running on GCE node
W20260807 20:19:51.064785 19134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:51.065035 19080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:51.065317 19080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:51.066474 19080 hybrid_clock.cc:648] HybridClock initialized: now 1786133991066454 us; error 35 us; skew 500 ppm
Aug 07 20:19:51 dist-test-slave-t7g5 krb5kdc[17508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:51.069798 19080 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:19:51.070282 19080 webserver.cc:460] Webserver started at http://127.30.35.193:44329/ using document root <none> and password file <none>
I20260807 20:19:51.070542 19080 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:51.070603 19080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 20:19:51 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:51.096099 19080 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:19:51.104417 19150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:51.104621 19080 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.000s sys 0.000s
I20260807 20:19:51.104707 19080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "52010c1f2be8460db569ec2d247cbeec"
format_stamp: "Formatted at 2026-08-07 20:19:50 on dist-test-slave-t7g5"
server_key: "4ca691f052e2bf182d6a50882de11dc7"
server_key_iv: "f92df5a31ae8dbe6a798e580e5974730"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:51.105154 19080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:51.131389 19080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:51.133399 19080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:51.133522 19080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:51.133778 19080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:19:51.134126 19080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:19:51.134166 19080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:51.134196 19080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:19:51.134217 19080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:51.141016 19080 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:36703
I20260807 20:19:51.141173 19317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:36703 every 8 connection(s)
I20260807 20:19:51.141541 19080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:19:51.144636 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 19080
I20260807 20:19:51.145004 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.35.212:38555/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:40763
--local_ip_for_outbound_sockets=127.30.35.194
--tserver_master_addrs=127.30.35.254:33499
--webserver_port=36001
--webserver_interface=127.30.35.194
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.35.212:38555/kms with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 20:19:51 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:51.155268 19324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:51.143069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:56665 (local address 127.30.35.254:33499)
0807 20:19:51.144224 (+ 1155us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:51.144234 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:51.144271 (+ 37us) server_negotiation.cc:407] Connection header received
0807 20:19:51.144430 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:51.144437 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:51.144497 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:51.144630 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:51.145440 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:51.146702 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:51.148076 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:51.148630 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:51.148707 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:51.151135 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:51.151140 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:51.151140 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:51.151152 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:51.153126 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:51.153626 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:51.153630 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:51.153630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:51.153780 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:51.154092 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:51.154093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:51.154093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:51.154407 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:51.154471 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:51.154909 (+ 438us) server_negotiation.cc:299] Negotiation successful
0807 20:19:51.155038 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1097,"thread_start_us":82,"threads_started":1}
I20260807 20:19:51.155802 19321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:51.142699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33499 (local address 127.30.35.193:56665)
0807 20:19:51.143397 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:51.143441 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:51.144016 (+ 575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:51.144806 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:51.144810 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:51.145023 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:51.145314 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:51.145321 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:51.146802 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:51.146803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:51.147973 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:51.147977 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:51.148854 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:51.148855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:51.148979 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:51.149485 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:51.149496 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:51.151009 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:51.153225 (+ 2216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:51.153232 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:51.153234 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:51.153524 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:51.153875 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:51.153876 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:51.153876 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:51.154011 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:51.154524 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:51.154532 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:51.154691 (+ 159us) client_negotiation.cc:769] Sending connection context
0807 20:19:51.155399 (+ 708us) client_negotiation.cc:240] Negotiation successful
0807 20:19:51.155572 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":84,"threads_started":1}
I20260807 20:19:51.156672 19318 heartbeater.cc:347] Connected to a master server at 127.30.35.254:33499
I20260807 20:19:51.156769 19318 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:51.156936 19318 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
W20260807 20:19:51.157799 19318 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:33499 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 20:19:51.157863 19318 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:51.157928 19318 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
I20260807 20:19:51.158258 19318 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:51.158345 19318 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
W20260807 20:19:51.158728 19318 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 20:19:51.262930 19325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:51.263201 19325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:51.263240 19325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:51.264825 19325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:51.264892 19325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:51.264930 19325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:19:51.267023 19325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.35.212:38555/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:40763
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=36001
--tserver_master_addrs=127.30.35.254:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:51.267270 19325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:51.267544 19325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:51.273635 19337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:51.273994 19334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:51.274370 19325 server_base.cc:1034] running on GCE node
W20260807 20:19:51.274430 19340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:51.274745 19325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:51.275027 19325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:51.276238 19325 hybrid_clock.cc:648] HybridClock initialized: now 1786133991276217 us; error 35 us; skew 500 ppm
Aug 07 20:19:51 dist-test-slave-t7g5 krb5kdc[17508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:51.279605 19325 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:19:51.280166 19325 webserver.cc:460] Webserver started at http://127.30.35.194:36001/ using document root <none> and password file <none>
I20260807 20:19:51.280442 19325 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:51.280532 19325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 20:19:51 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:51.295322 19325 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:19:51.296427 19351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:51.296659 19325 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:19:51.296764 19325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "e810c6651ff74fc5952071c5f4792d31"
format_stamp: "Formatted at 2026-08-07 20:19:50 on dist-test-slave-t7g5"
server_key: "3310c6e01e84f58c543d73279f9bf521"
server_key_iv: "78e3683bdf40ba34e1d5da3583a14eb4"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:51.297230 19325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:51.311975 19325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:51.314189 19325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:51.314354 19325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:51.314615 19325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:19:51.315011 19325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:19:51.315065 19325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:51.315104 19325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:19:51.315131 19325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:51.322647 19325 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:40763
I20260807 20:19:51.322685 19519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:40763 every 8 connection(s)
I20260807 20:19:51.323180 19325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:19:51.323612 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 19325
I20260807 20:19:51.323879 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.30.35.212:38555/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:39991
--local_ip_for_outbound_sockets=127.30.35.195
--tserver_master_addrs=127.30.35.254:33499
--webserver_port=33783
--webserver_interface=127.30.35.195
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.30.35.212:38555/kms with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 20:19:51 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:51.336527 19324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:51.326037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:35139 (local address 127.30.35.254:33499)
0807 20:19:51.326086 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:51.326088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:51.326363 (+ 275us) server_negotiation.cc:407] Connection header received
0807 20:19:51.327037 (+ 674us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:51.327039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:51.327051 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:51.327079 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:51.327856 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:51.328622 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:51.330152 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:51.330458 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:51.330521 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:51.333195 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:51.333197 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:51.333197 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:51.333205 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:51.334874 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:51.335384 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:51.335386 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:51.335386 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:51.335449 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:51.335764 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:51.335765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:51.335766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:51.335901 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:51.335959 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:51.336336 (+ 377us) server_negotiation.cc:299] Negotiation successful
0807 20:19:51.336427 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:19:51.337237 19524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:51.326037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33499 (local address 127.30.35.194:35139)
0807 20:19:51.326227 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:51.326275 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:51.326895 (+ 620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:51.327259 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:51.327264 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:51.327476 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:51.327742 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:51.327748 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:51.328746 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:51.328747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:51.330034 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:51.330038 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:51.330670 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:51.330671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:51.330812 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:51.331417 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:51.331427 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:51.333075 (+ 1648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:51.334986 (+ 1911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:51.334993 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:51.334995 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:51.335288 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:51.335542 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:51.335543 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:51.335543 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:51.335681 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:51.336011 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:51.336018 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:51.336183 (+ 165us) client_negotiation.cc:769] Sending connection context
0807 20:19:51.336846 (+ 663us) client_negotiation.cc:240] Negotiation successful
0807 20:19:51.337016 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":101,"threads_started":1}
I20260807 20:19:51.337867 19520 heartbeater.cc:347] Connected to a master server at 127.30.35.254:33499
I20260807 20:19:51.337968 19520 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:51.338145 19520 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
W20260807 20:19:51.338774 19520 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:33499 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 20:19:51.338838 19520 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:51.338892 19520 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
I20260807 20:19:51.339304 19520 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:51.339398 19520 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
W20260807 20:19:51.339733 19520 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 20:19:51.433939 19522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:51.434150 19522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:51.434180 19522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:51.435377 19522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:51.435420 19522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:51.435489 19522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:19:51.436990 19522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.30.35.212:38555/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:39991
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=33783
--tserver_master_addrs=127.30.35.254:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:51.437215 19522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:51.437467 19522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:51.442314 19545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:51.442312 19537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:51.443019 19522 server_base.cc:1034] running on GCE node
W20260807 20:19:51.444976 19534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:51.445325 19522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:51.445616 19522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:51.448925 19522 hybrid_clock.cc:648] HybridClock initialized: now 1786133991448886 us; error 47 us; skew 500 ppm
Aug 07 20:19:51 dist-test-slave-t7g5 krb5kdc[17508](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:51.452530 19522 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:19:51.452996 19522 webserver.cc:460] Webserver started at http://127.30.35.195:33783/ using document root <none> and password file <none>
I20260807 20:19:51.453212 19522 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:51.453275 19522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 20:19:51 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:51.467730 19522 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:19:51.470333 19558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:51.470506 19522 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 20:19:51.470600 19522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "5ba5fc62b92b40b6be89d6608ca408ce"
format_stamp: "Formatted at 2026-08-07 20:19:50 on dist-test-slave-t7g5"
server_key: "f06c1bd7c67c05150461b68629aab0dc"
server_key_iv: "35e78f5d5766557d28dbbf7b7c54f9d8"
server_key_version: "kuduclusterkey@0"
I20260807 20:19:51.471067 19522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:51.490525 19522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:51.492863 19522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:51.493026 19522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:51.493292 19522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:19:51.493701 19522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:19:51.493746 19522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:51.493777 19522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:19:51.493793 19522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:51.500537 19522 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:39991
I20260807 20:19:51.500708 19723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:39991 every 8 connection(s)
I20260807 20:19:51.500975 19522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
Aug 07 20:19:51 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133991, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:51.510740 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 19522
I20260807 20:19:51.511587 19324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:51.501732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:46173 (local address 127.30.35.254:33499)
0807 20:19:51.501778 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:51.501780 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:51.502074 (+ 294us) server_negotiation.cc:407] Connection header received
0807 20:19:51.502564 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:51.502566 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:51.502580 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:51.502628 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:51.503223 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:51.503745 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:51.505212 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:51.505406 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:51.505470 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:51.507925 (+ 2455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:51.507927 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:51.507927 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:51.507944 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:51.509943 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:51.510408 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:51.510409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:51.510410 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:51.510469 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:51.510760 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:51.510761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:51.510762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:51.510906 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:51.510950 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:51.511404 (+ 454us) server_negotiation.cc:299] Negotiation successful
0807 20:19:51.511493 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 20:19:51.512338 19728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:51.501733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:33499 (local address 127.30.35.195:46173)
0807 20:19:51.501933 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:51.501972 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:51.502465 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:51.502710 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:51.502714 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:51.502919 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:51.503132 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:51.503139 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:51.503849 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:51.503851 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:51.505120 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:51.505123 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:51.505518 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:51.505520 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:51.505692 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:51.506168 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:51.506178 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:51.507823 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:51.510023 (+ 2200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:51.510030 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:51.510032 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:51.510327 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:51.510524 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:51.510525 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:51.510525 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:51.510666 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:51.511051 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:51.511058 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:51.511223 (+ 165us) client_negotiation.cc:769] Sending connection context
0807 20:19:51.511936 (+ 713us) client_negotiation.cc:240] Negotiation successful
0807 20:19:51.512104 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":91,"threads_started":1}
I20260807 20:19:51.513123 19724 heartbeater.cc:347] Connected to a master server at 127.30.35.254:33499
I20260807 20:19:51.513242 19724 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:51.513466 19724 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
W20260807 20:19:51.514240 19724 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:33499 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 20:19:51.514305 19724 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:51.514350 19724 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
I20260807 20:19:51.514726 19724 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:51.514806 19724 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
W20260807 20:19:51.515105 19724 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 20:19:51.525547 19324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:51.511150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42706 (local address 127.30.35.254:33499)
0807 20:19:51.511905 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:51.511906 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:51.517866 (+ 5960us) server_negotiation.cc:407] Connection header received
0807 20:19:51.517893 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:51.517894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:51.517905 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:51.517991 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:51.518595 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:51.519346 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:51.520067 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:51.520362 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:51.520436 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:51.521639 (+ 1203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:51.521640 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:51.521641 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:51.521667 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:51.523274 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:51.523625 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:51.523626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:51.523626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:51.523693 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:51.524991 (+ 1298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:51.524993 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:51.524993 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:51.525137 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:51.525325 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:51.525370 (+ 45us) server_negotiation.cc:299] Negotiation successful
0807 20:19:51.525449 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":60,"threads_started":1}
Aug 07 20:19:52 dist-test-slave-t7g5 krb5kdc[17508](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786133992, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:52.158918 19318 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:52.159087 19318 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
I20260807 20:19:52.159505 19027 ts_manager.cc:194] Registered new tserver with Master: 52010c1f2be8460db569ec2d247cbeec (127.30.35.193:36703)
I20260807 20:19:52.160499 19027 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:56665
I20260807 20:19:52.339922 19520 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:52.340087 19520 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
I20260807 20:19:52.340590 19027 ts_manager.cc:194] Registered new tserver with Master: e810c6651ff74fc5952071c5f4792d31 (127.30.35.194:40763)
I20260807 20:19:52.341230 19027 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:35139
Aug 07 20:19:52 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133992, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:52.515267 19724 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:52.515426 19724 heartbeater.cc:511] Master 127.30.35.254:33499 requested a full tablet report, sending...
I20260807 20:19:52.515755 19027 ts_manager.cc:194] Registered new tserver with Master: 5ba5fc62b92b40b6be89d6608ca408ce (127.30.35.195:39991)
I20260807 20:19:52.516299 19027 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:46173
I20260807 20:19:52.524611 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:19:52.533818 19758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:52.525812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42720 (local address 127.30.35.254:33499)
0807 20:19:52.526122 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:52.526124 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:52.526131 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:19:52.526153 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:52.526153 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:52.526164 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:52.526228 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:52.526895 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.527675 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.528673 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.528980 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.529048 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:52.530541 (+ 1493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:52.530542 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:52.530543 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:52.530550 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:52.532490 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:52.532939 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:52.532940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:52.532941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:52.533009 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:52.533233 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:52.533233 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:52.533234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:52.533360 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:52.533462 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:52.533603 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 20:19:52.533706 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":79,"threads_started":1}
I20260807 20:19:52.536327 19027 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42720:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:19:52.538844 19027 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:19:52.550184 19773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:52.542031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:36703 (local address 127.0.0.1:50086)
0807 20:19:52.542654 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:52.542692 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:52.542755 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:52.545988 (+ 3233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:52.545992 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:52.545994 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:19:52.546065 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:52.546067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.547523 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.547524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:52.548808 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:52.548812 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.549880 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.549881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:52.549969 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:52.549986 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 20:19:52.550042 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 20:19:52.550096 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":90,"threads_started":1}
I20260807 20:19:52.550908 19772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:52.542132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50086 (local address 127.30.35.193:36703)
0807 20:19:52.545799 (+ 3667us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:52.545804 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:52.545818 (+ 14us) server_negotiation.cc:407] Connection header received
0807 20:19:52.545858 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:52.545860 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:52.545879 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:52.545977 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:19:52.546152 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.547225 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.548931 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.549761 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.550665 (+ 904us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:52.550752 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:52.550782 (+ 30us) server_negotiation.cc:299] Negotiation successful
0807 20:19:52.550823 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3628,"thread_start_us":58,"threads_started":1}
I20260807 20:19:52.551442 19769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:52.542251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:40763 (local address 127.0.0.1:32842)
0807 20:19:52.547354 (+ 5103us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:52.547364 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:52.547428 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:52.547662 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:52.547663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:52.547666 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:19:52.547729 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:52.547731 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.548884 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.548885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:52.550242 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:52.550245 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.551210 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.551211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:52.551268 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:52.551272 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:19:52.551314 (+ 42us) client_negotiation.cc:240] Negotiation successful
0807 20:19:52.551360 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5084,"thread_start_us":71,"threads_started":1}
I20260807 20:19:52.551658 19775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:52.542461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32842 (local address 127.30.35.194:40763)
0807 20:19:52.542997 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:52.543003 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:52.547440 (+ 4437us) server_negotiation.cc:407] Connection header received
0807 20:19:52.547485 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:52.547488 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:52.547504 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:52.547577 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:19:52.547794 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.548793 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.550323 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.551063 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.551127 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:52.551178 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:52.551540 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 20:19:52.551582 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":60,"threads_started":1}
I20260807 20:19:52.551788 19228 tablet_service.cc:1467] Processing CreateTablet for tablet a6bdcd1e415c4adcace68910a109f997 (DEFAULT_TABLE table=test-table [id=58d5cf80b78b4f328db3b84135d4cf39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:19:52.552205 19228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6bdcd1e415c4adcace68910a109f997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:19:52.556238 19778 tablet_bootstrap.cc:492] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec: Bootstrap starting.
I20260807 20:19:52.556977 19778 tablet_bootstrap.cc:654] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec: Neither blocks nor log segments found. Creating new log.
I20260807 20:19:52.557157 19430 tablet_service.cc:1467] Processing CreateTablet for tablet a6bdcd1e415c4adcace68910a109f997 (DEFAULT_TABLE table=test-table [id=58d5cf80b78b4f328db3b84135d4cf39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:19:52.557338 19778 log.cc:824] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec: Log is configured to *not* fsync() on all Append() calls
I20260807 20:19:52.557521 19430 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6bdcd1e415c4adcace68910a109f997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:19:52.558151 19778 tablet_bootstrap.cc:492] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec: No bootstrap required, opened a new log
I20260807 20:19:52.558210 19778 ts_tablet_manager.cc:1397] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:19:52.560895 19778 raft_consensus.cc:348] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ba5fc62b92b40b6be89d6608ca408ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39991 } } peers { permanent_uuid: "52010c1f2be8460db569ec2d247cbeec" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36703 } } peers { permanent_uuid: "e810c6651ff74fc5952071c5f4792d31" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40763 } }
I20260807 20:19:52.561053 19778 raft_consensus.cc:374] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:19:52.561080 19778 raft_consensus.cc:729] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52010c1f2be8460db569ec2d247cbeec, State: Initialized, Role: FOLLOWER
I20260807 20:19:52.561219 19778 consensus_queue.cc:260] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ba5fc62b92b40b6be89d6608ca408ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39991 } } peers { permanent_uuid: "52010c1f2be8460db569ec2d247cbeec" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36703 } } peers { permanent_uuid: "e810c6651ff74fc5952071c5f4792d31" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40763 } }
I20260807 20:19:52.561508 19778 ts_tablet_manager.cc:1428] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260807 20:19:52.561620 19318 heartbeater.cc:503] Master 127.30.35.254:33499 was elected leader, sending a full tablet report...
I20260807 20:19:52.563002 19783 tablet_bootstrap.cc:492] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31: Bootstrap starting.
I20260807 20:19:52.563683 19783 tablet_bootstrap.cc:654] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31: Neither blocks nor log segments found. Creating new log.
I20260807 20:19:52.564056 19783 log.cc:824] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31: Log is configured to *not* fsync() on all Append() calls
I20260807 20:19:52.564815 19783 tablet_bootstrap.cc:492] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31: No bootstrap required, opened a new log
I20260807 20:19:52.564877 19783 ts_tablet_manager.cc:1397] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:19:52.566890 19768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:52.542035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:39991 (local address 127.0.0.1:48464)
0807 20:19:52.542857 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:52.542864 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:52.542896 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:52.562881 (+ 19985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:52.562882 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:52.562885 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:19:52.562954 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:52.562956 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.564276 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.564278 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:52.565378 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:52.565382 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.566634 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.566636 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:52.566706 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:52.566726 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 20:19:52.566764 (+ 38us) client_negotiation.cc:240] Negotiation successful
0807 20:19:52.566807 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":806,"thread_start_us":101,"threads_started":1}
I20260807 20:19:52.567288 19774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:52.542309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48464 (local address 127.30.35.195:39991)
0807 20:19:52.562661 (+ 20352us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:52.562666 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:52.562679 (+ 13us) server_negotiation.cc:407] Connection header received
0807 20:19:52.562730 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:52.562732 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:52.562751 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:52.563053 (+ 302us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:19:52.563147 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.564155 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.565499 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.566525 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.567067 (+ 542us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:52.567137 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:52.567165 (+ 28us) server_negotiation.cc:299] Negotiation successful
0807 20:19:52.567205 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20311,"thread_start_us":65,"threads_started":1}
I20260807 20:19:52.567214 19783 raft_consensus.cc:348] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ba5fc62b92b40b6be89d6608ca408ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39991 } } peers { permanent_uuid: "52010c1f2be8460db569ec2d247cbeec" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36703 } } peers { permanent_uuid: "e810c6651ff74fc5952071c5f4792d31" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40763 } }
I20260807 20:19:52.567359 19783 raft_consensus.cc:374] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:19:52.567386 19783 raft_consensus.cc:729] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e810c6651ff74fc5952071c5f4792d31, State: Initialized, Role: FOLLOWER
I20260807 20:19:52.567497 19783 consensus_queue.cc:260] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ba5fc62b92b40b6be89d6608ca408ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39991 } } peers { permanent_uuid: "52010c1f2be8460db569ec2d247cbeec" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36703 } } peers { permanent_uuid: "e810c6651ff74fc5952071c5f4792d31" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40763 } }
I20260807 20:19:52.567739 19783 ts_tablet_manager.cc:1428] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:19:52.567878 19520 heartbeater.cc:503] Master 127.30.35.254:33499 was elected leader, sending a full tablet report...
I20260807 20:19:52.567956 19632 tablet_service.cc:1467] Processing CreateTablet for tablet a6bdcd1e415c4adcace68910a109f997 (DEFAULT_TABLE table=test-table [id=58d5cf80b78b4f328db3b84135d4cf39]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:19:52.568276 19632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a6bdcd1e415c4adcace68910a109f997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:19:52.571476 19787 tablet_bootstrap.cc:492] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce: Bootstrap starting.
I20260807 20:19:52.572202 19787 tablet_bootstrap.cc:654] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce: Neither blocks nor log segments found. Creating new log.
I20260807 20:19:52.572535 19787 log.cc:824] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce: Log is configured to *not* fsync() on all Append() calls
I20260807 20:19:52.573439 19787 tablet_bootstrap.cc:492] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce: No bootstrap required, opened a new log
I20260807 20:19:52.573522 19787 ts_tablet_manager.cc:1397] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
W20260807 20:19:52.576246 19521 tablet.cc:2369] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:19:52.576380 19787 raft_consensus.cc:348] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ba5fc62b92b40b6be89d6608ca408ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39991 } } peers { permanent_uuid: "52010c1f2be8460db569ec2d247cbeec" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36703 } } peers { permanent_uuid: "e810c6651ff74fc5952071c5f4792d31" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40763 } }
I20260807 20:19:52.576563 19787 raft_consensus.cc:374] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:19:52.576608 19787 raft_consensus.cc:729] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ba5fc62b92b40b6be89d6608ca408ce, State: Initialized, Role: FOLLOWER
I20260807 20:19:52.576786 19787 consensus_queue.cc:260] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ba5fc62b92b40b6be89d6608ca408ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39991 } } peers { permanent_uuid: "52010c1f2be8460db569ec2d247cbeec" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36703 } } peers { permanent_uuid: "e810c6651ff74fc5952071c5f4792d31" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40763 } }
I20260807 20:19:52.577101 19787 ts_tablet_manager.cc:1428] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260807 20:19:52.577243 19724 heartbeater.cc:503] Master 127.30.35.254:33499 was elected leader, sending a full tablet report...
W20260807 20:19:52.644230 19320 tablet.cc:2369] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 20:19:52 dist-test-slave-t7g5 krb5kdc[17508](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133992, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for HTTP/127.30.35.212@KRBTEST.COM
I20260807 20:19:52.686618 19785 raft_consensus.cc:482] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:19:52.686779 19785 raft_consensus.cc:504] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ba5fc62b92b40b6be89d6608ca408ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39991 } } peers { permanent_uuid: "52010c1f2be8460db569ec2d247cbeec" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36703 } } peers { permanent_uuid: "e810c6651ff74fc5952071c5f4792d31" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40763 } }
I20260807 20:19:52.687172 19785 leader_election.cc:288] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ba5fc62b92b40b6be89d6608ca408ce (127.30.35.195:39991), 52010c1f2be8460db569ec2d247cbeec (127.30.35.193:36703)
I20260807 20:19:52.691586 19774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:52.687812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:38013 (local address 127.30.35.195:39991)
0807 20:19:52.687869 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:52.687871 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:52.688036 (+ 165us) server_negotiation.cc:407] Connection header received
0807 20:19:52.688131 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:52.688132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:52.688142 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:52.688169 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:19:52.688397 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.689097 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.690613 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.691164 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.691212 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:52.691221 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:52.691470 (+ 249us) server_negotiation.cc:299] Negotiation successful
0807 20:19:52.691511 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:19:52.691847 19792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:52.687384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:39991 (local address 127.30.35.194:38013)
0807 20:19:52.687973 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:52.687983 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:52.688064 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:52.688230 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:52.688230 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:52.688232 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:19:52.688324 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:52.688325 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.689201 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.689202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:52.690507 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:52.690511 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.691300 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.691301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:52.691390 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:52.691394 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:19:52.691706 (+ 312us) client_negotiation.cc:240] Negotiation successful
0807 20:19:52.691749 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":98,"threads_started":1}
I20260807 20:19:52.692175 19658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6bdcd1e415c4adcace68910a109f997" candidate_uuid: "e810c6651ff74fc5952071c5f4792d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba5fc62b92b40b6be89d6608ca408ce" is_pre_election: true
I20260807 20:19:52.692366 19658 raft_consensus.cc:2454] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e810c6651ff74fc5952071c5f4792d31 in term 0.
I20260807 20:19:52.692605 19355 leader_election.cc:302] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ba5fc62b92b40b6be89d6608ca408ce, e810c6651ff74fc5952071c5f4792d31; no voters:
I20260807 20:19:52.692742 19785 raft_consensus.cc:2781] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:19:52.692792 19785 raft_consensus.cc:482] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:19:52.692819 19785 raft_consensus.cc:3037] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:19:52.693893 19785 raft_consensus.cc:504] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ba5fc62b92b40b6be89d6608ca408ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39991 } } peers { permanent_uuid: "52010c1f2be8460db569ec2d247cbeec" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36703 } } peers { permanent_uuid: "e810c6651ff74fc5952071c5f4792d31" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40763 } }
I20260807 20:19:52.694041 19785 leader_election.cc:288] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [CANDIDATE]: Term 1 election: Requested vote from peers 5ba5fc62b92b40b6be89d6608ca408ce (127.30.35.195:39991), 52010c1f2be8460db569ec2d247cbeec (127.30.35.193:36703)
I20260807 20:19:52.694237 19658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6bdcd1e415c4adcace68910a109f997" candidate_uuid: "e810c6651ff74fc5952071c5f4792d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ba5fc62b92b40b6be89d6608ca408ce"
I20260807 20:19:52.694319 19658 raft_consensus.cc:3037] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:19:52.695230 19658 raft_consensus.cc:2454] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e810c6651ff74fc5952071c5f4792d31 in term 1.
I20260807 20:19:52.695451 19772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:52.687886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:57015 (local address 127.30.35.193:36703)
0807 20:19:52.687952 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:52.687954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:52.692527 (+ 4573us) server_negotiation.cc:407] Connection header received
0807 20:19:52.692645 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:52.692647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:52.692658 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:52.692687 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:19:52.692915 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.693548 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.694747 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.695133 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.695168 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:52.695174 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:52.695337 (+ 163us) server_negotiation.cc:299] Negotiation successful
0807 20:19:52.695377 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 20:19:52.695449 19355 leader_election.cc:302] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ba5fc62b92b40b6be89d6608ca408ce, e810c6651ff74fc5952071c5f4792d31; no voters:
I20260807 20:19:52.695684 19791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:52.687589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:36703 (local address 127.30.35.194:57015)
0807 20:19:52.692451 (+ 4862us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:52.692463 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:52.692560 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:52.692752 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:52.692752 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:52.692754 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:19:52.692838 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:52.692840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.693643 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.693643 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:52.694649 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:52.694652 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.695217 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.695218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:52.695267 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:52.695269 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 20:19:52.695552 (+ 283us) client_negotiation.cc:240] Negotiation successful
0807 20:19:52.695594 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4839,"thread_start_us":66,"threads_started":1}
I20260807 20:19:52.695739 19785 raft_consensus.cc:2781] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:19:52.695880 19785 raft_consensus.cc:686] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [term 1 LEADER]: Becoming Leader. State: Replica: e810c6651ff74fc5952071c5f4792d31, State: Running, Role: LEADER
I20260807 20:19:52.695971 19785 consensus_queue.cc:237] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ba5fc62b92b40b6be89d6608ca408ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39991 } } peers { permanent_uuid: "52010c1f2be8460db569ec2d247cbeec" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36703 } } peers { permanent_uuid: "e810c6651ff74fc5952071c5f4792d31" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40763 } }
I20260807 20:19:52.696653 19255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6bdcd1e415c4adcace68910a109f997" candidate_uuid: "e810c6651ff74fc5952071c5f4792d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52010c1f2be8460db569ec2d247cbeec" is_pre_election: true
I20260807 20:19:52.696812 19255 raft_consensus.cc:2454] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e810c6651ff74fc5952071c5f4792d31 in term 0.
I20260807 20:19:52.696938 19254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6bdcd1e415c4adcace68910a109f997" candidate_uuid: "e810c6651ff74fc5952071c5f4792d31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52010c1f2be8460db569ec2d247cbeec"
I20260807 20:19:52.697000 19254 raft_consensus.cc:3037] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:19:52.697861 19254 raft_consensus.cc:2454] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e810c6651ff74fc5952071c5f4792d31 in term 1.
I20260807 20:19:52.698153 19027 catalog_manager.cc:5495] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 reported cstate change: term changed from 0 to 1, leader changed from <none> to e810c6651ff74fc5952071c5f4792d31 (127.30.35.194). New cstate: current_term: 1 leader_uuid: "e810c6651ff74fc5952071c5f4792d31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ba5fc62b92b40b6be89d6608ca408ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "52010c1f2be8460db569ec2d247cbeec" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e810c6651ff74fc5952071c5f4792d31" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40763 } health_report { overall_health: HEALTHY } } }
I20260807 20:19:52.749418 19775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:52.746087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32852 (local address 127.30.35.194:40763)
0807 20:19:52.746133 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:52.746135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:52.746144 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:19:52.746202 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:52.746205 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:52.746231 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:52.746315 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:19:52.746528 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.747275 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.748254 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:52.748543 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:52.748613 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:52.748859 (+ 246us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:19:52.749008 (+ 149us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:19:52.749089 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:52.749308 (+ 219us) server_negotiation.cc:299] Negotiation successful
0807 20:19:52.749333 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 20:19:52.752314 19726 tablet.cc:2369] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:19:52.759296 19658 raft_consensus.cc:1261] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce [term 1 FOLLOWER]: Refusing update from remote peer e810c6651ff74fc5952071c5f4792d31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:19:52.759342 19254 raft_consensus.cc:1261] T a6bdcd1e415c4adcace68910a109f997 P 52010c1f2be8460db569ec2d247cbeec [term 1 FOLLOWER]: Refusing update from remote peer e810c6651ff74fc5952071c5f4792d31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:19:52.759728 19795 consensus_queue.cc:1035] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "52010c1f2be8460db569ec2d247cbeec" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:19:52.759913 19795 consensus_queue.cc:1035] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ba5fc62b92b40b6be89d6608ca408ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 39991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:19:52.768098 19801 mvcc.cc:205] Tried to move back new op lower bound from 7316004834336948224 to 7316004834083172352. Current Snapshot: MvccSnapshot[applied={T|T < 7316004834336948224}]
I20260807 20:19:52.770480 19803 mvcc.cc:205] Tried to move back new op lower bound from 7316004834336948224 to 7316004834083172352. Current Snapshot: MvccSnapshot[applied={T|T < 7316004834336948224}]
I20260807 20:19:52.773016 19806 mvcc.cc:205] Tried to move back new op lower bound from 7316004834336948224 to 7316004834083172352. Current Snapshot: MvccSnapshot[applied={T|T < 7316004834336948224 or (T in {7316004834336948224})}]
I20260807 20:19:52.773350 19024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:19:52.773452 19024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:19:52.774137 19024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8fe6199b4be642cd848e67301a312a99: Sending DeleteTablet for 3 replicas of tablet a6bdcd1e415c4adcace68910a109f997
I20260807 20:19:52.774488 19632 tablet_service.cc:1514] Processing DeleteTablet for tablet a6bdcd1e415c4adcace68910a109f997 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:19:52 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:48464
I20260807 20:19:52.774938 19228 tablet_service.cc:1514] Processing DeleteTablet for tablet a6bdcd1e415c4adcace68910a109f997 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:19:52 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:50086
I20260807 20:19:52.775180 19430 tablet_service.cc:1514] Processing DeleteTablet for tablet a6bdcd1e415c4adcace68910a109f997 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:19:52 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:32842
I20260807 20:19:52.775789 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 19080
I20260807 20:19:52.790781 19817 tablet_replica.cc:330] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31: stopping tablet replica
I20260807 20:19:52.790918 19817 raft_consensus.cc:2229] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:19:52.791057 19817 raft_consensus.cc:2258] T a6bdcd1e415c4adcace68910a109f997 P e810c6651ff74fc5952071c5f4792d31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:19:52.793877 19815 tablet_replica.cc:330] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce: stopping tablet replica
I20260807 20:19:52.794016 19815 raft_consensus.cc:2229] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:19:52.794134 19815 raft_consensus.cc:2258] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:19:52.794649 19815 ts_tablet_manager.cc:1905] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:19:52.798388 19815 ts_tablet_manager.cc:1918] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:19:52.798470 19815 log.cc:1196] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/a6bdcd1e415c4adcace68910a109f997
I20260807 20:19:52.798730 19815 ts_tablet_manager.cc:1939] T a6bdcd1e415c4adcace68910a109f997 P 5ba5fc62b92b40b6be89d6608ca408ce: Deleting consensus metadata
I20260807 20:19:52.799203 19003 catalog_manager.cc:4841] TS 5ba5fc62b92b40b6be89d6608ca408ce (127.30.35.195:39991): tablet a6bdcd1e415c4adcace68910a109f997 (table test-table [id=58d5cf80b78b4f328db3b84135d4cf39]) successfully deleted
W20260807 20:19:52.799440 19005 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:36703 (error 108)
I20260807 20:19:52.800159 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 19325
I20260807 20:19:52.834408 19768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:52.834257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:36703 (local address 127.0.0.1:50100)
0807 20:19:52.834315 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:52.834359 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:36703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 20:19:52.834573 19005 catalog_manager.cc:4584] TS 52010c1f2be8460db569ec2d247cbeec (127.30.35.193:36703): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a6bdcd1e415c4adcace68910a109f997: Network error: Client connection negotiation failed: client connection to 127.30.35.193:36703: connect: Connection refused (error 111)
I20260807 20:19:52.835619 19768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:52.835509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:40763 (local address 127.0.0.1:32864)
0807 20:19:52.835568 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:52.835588 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.194:40763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260807 20:19:52.835637 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 19522
I20260807 20:19:52.843091 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 18977
I20260807 20:19:52.854195 30863 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 20:19:53.197611 30863 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 20:19:53.197724 30863 mini_ranger.cc:66] Stopping Ranger...
I20260807 20:19:53.541326 30863 mini_ranger.cc:68] Stopped Ranger
2026-08-07 20:19:53.541 UTC [17563] LOG: received smart shutdown request
2026-08-07 20:19:53.546 UTC [17563] LOG: background worker "logical replication launcher" (PID 17574) exited with exit code 1
2026-08-07 20:19:53.546 UTC [17567] LOG: shutting down
2026-08-07 20:19:53.685 UTC [17563] LOG: database system is shut down
2026-08-07T20:19:53Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47108 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:19:53 dist-test-slave-t7g5 krb5kdc[19835](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:19:53 dist-test-slave-t7g5 krb5kdc[19835](info): set up 2 sockets
Aug 07 20:19:53 dist-test-slave-t7g5 krb5kdc[19835](info): commencing operation
krb5kdc: starting...
W20260807 20:19:54.903352 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:19:54 dist-test-slave-t7g5 krb5kdc[19835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133994, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:19:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:19:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:19:55.019848 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:45549
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:43949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:45549,127.30.35.253:33393,127.30.35.252:34715
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:19:55.100808 19855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:55.101013 19855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:55.101044 19855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:55.102192 19855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:19:55.102233 19855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:55.102252 19855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:55.102267 19855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:19:55.102283 19855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:19:55.103750 19855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:43949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:45549,127.30.35.253:33393,127.30.35.252:34715
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:45549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:55.104002 19855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:55.104207 19855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:55.108737 19863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:55.108760 19862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:55.108907 19855 server_base.cc:1034] running on GCE node
W20260807 20:19:55.108777 19866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:55.109273 19855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:55.109551 19855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:55.110723 19855 hybrid_clock.cc:648] HybridClock initialized: now 1786133995110715 us; error 36 us; skew 500 ppm
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133995, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:55.115723 19855 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:19:55.116153 19855 webserver.cc:460] Webserver started at http://127.30.35.254:46831/ using document root <none> and password file <none>
I20260807 20:19:55.116353 19855 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:55.116401 19855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:55.116525 19855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:19:55.117545 19855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "41a86c9cd48b4e23bed41a961ac451e5"
format_stamp: "Formatted at 2026-08-07 20:19:55 on dist-test-slave-t7g5"
server_key: "9e95e3e12f7bb75e80e2ce5a1b20ae74"
server_key_iv: "6a4698ab532ce6f9570d4d0e61df9da4"
server_key_version: "encryptionkey@0"
I20260807 20:19:55.117914 19855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "41a86c9cd48b4e23bed41a961ac451e5"
format_stamp: "Formatted at 2026-08-07 20:19:55 on dist-test-slave-t7g5"
server_key: "9e95e3e12f7bb75e80e2ce5a1b20ae74"
server_key_iv: "6a4698ab532ce6f9570d4d0e61df9da4"
server_key_version: "encryptionkey@0"
I20260807 20:19:55.119122 19855 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:19:55.119766 19874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:55.119915 19855 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:19:55.120009 19855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "41a86c9cd48b4e23bed41a961ac451e5"
format_stamp: "Formatted at 2026-08-07 20:19:55 on dist-test-slave-t7g5"
server_key: "9e95e3e12f7bb75e80e2ce5a1b20ae74"
server_key_iv: "6a4698ab532ce6f9570d4d0e61df9da4"
server_key_version: "encryptionkey@0"
I20260807 20:19:55.120077 19855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:55.143029 19855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:55.145213 19855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:55.145360 19855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:55.149297 19855 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:45549
I20260807 20:19:55.149335 19949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:45549 every 8 connection(s)
I20260807 20:19:55.149695 19855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:19:55.150548 19951 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:19:55.152089 19951 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:19:55.154928 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 19855
I20260807 20:19:55.155036 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:19:55.155232 30863 external_mini_cluster.cc:1428] Setting key b4bfc9cb05519d74aac8e470310a845e
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133995, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:55.161684 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.152748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:45549 (local address 127.0.0.1:43004)
0807 20:19:55.152922 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.152962 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:55.153533 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:55.153802 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:55.153805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:55.154054 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:55.154216 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.154220 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.155450 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.155451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.156134 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.156136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.156739 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.156740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.156814 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.157291 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:55.157301 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:55.158783 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:55.160343 (+ 1560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.160350 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.160352 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.160535 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.160738 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.160738 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.160739 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.160819 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.161129 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:55.161134 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:55.161194 (+ 60us) client_negotiation.cc:769] Sending connection context
0807 20:19:55.161274 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 20:19:55.161482 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":76,"thread_start_us":85,"threads_started":1}
I20260807 20:19:55.161686 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.152775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43004 (local address 127.30.35.254:45549)
0807 20:19:55.152990 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.152994 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.153035 (+ 41us) server_negotiation.cc:407] Connection header received
0807 20:19:55.153686 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.153688 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.153709 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.153783 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.154286 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.155357 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.156214 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.156662 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.156785 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.158861 (+ 2076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.158869 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.158869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.158877 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.160267 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.160603 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.160607 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.160607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.160681 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.160871 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.160872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.160872 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.161069 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.161139 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.161307 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.161417 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":73,"threads_started":1}
I20260807 20:19:55.162334 19951 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:19:55.162642 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.162542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:33393 (local address 127.0.0.1:41988)
0807 20:19:55.162574 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.162618 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:33393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260807 20:19:55.162765 19876 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.35.253:33393: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.30.35.253@KRBTEST.COM; defaulting to no policy
I20260807 20:19:55.163136 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.163057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:33393 (local address 127.0.0.1:42000)
0807 20:19:55.163091 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.163112 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:33393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260807 20:19:55.163251 19951 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.253:33393: Network error: Client connection negotiation failed: client connection to 127.30.35.253:33393: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.253.keytab.
Entry for principal kudu/127.30.35.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.253.keytab.
I20260807 20:19:55.178829 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.253:33393
--webserver_interface=127.30.35.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.253.keytab
--principal=kudu/127.30.35.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:43949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:45549,127.30.35.253:33393,127.30.35.252:34715
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:19:55.212460 19951 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } attempt: 1
I20260807 20:19:55.213011 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.212878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:33393 (local address 127.0.0.1:42014)
0807 20:19:55.212939 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.212982 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:33393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 20:19:55.213326 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.213246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:33393 (local address 127.0.0.1:42028)
0807 20:19:55.213282 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.213307 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:33393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260807 20:19:55.213413 19951 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.253:33393: Network error: Client connection negotiation failed: client connection to 127.30.35.253:33393: connect: Connection refused (error 111)
W20260807 20:19:55.260994 19963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:55.261202 19963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:55.261224 19963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:55.262334 19963 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:19:55.262372 19963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:55.262385 19963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:55.262396 19963 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:19:55.262413 19963 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:19:55.263926 19963 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:43949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:45549,127.30.35.253:33393,127.30.35.252:34715
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.253.keytab
--principal=kudu/127.30.35.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.253:33393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.35.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:55.264130 19963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:55.264312 19963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:55.268870 19977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:55.268872 19975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:55.268955 19963 server_base.cc:1034] running on GCE node
W20260807 20:19:55.268904 19981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:55.269335 19963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:55.269637 19963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:55.270802 19963 hybrid_clock.cc:648] HybridClock initialized: now 1786133995270771 us; error 51 us; skew 500 ppm
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133995, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:55.273216 19963 init.cc:377] Logged in from keytab as kudu/127.30.35.253@KRBTEST.COM (short username kudu)
I20260807 20:19:55.273627 19963 webserver.cc:460] Webserver started at http://127.30.35.253:34287/ using document root <none> and password file <none>
I20260807 20:19:55.273869 19963 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:55.273914 19963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:55.274010 19963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:19:55.274992 19963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/data/instance:
uuid: "f021a7a4f9dc4050a21a745348af8786"
format_stamp: "Formatted at 2026-08-07 20:19:55 on dist-test-slave-t7g5"
server_key: "dbecf8af0bfb6b9d1df71cd4da44579a"
server_key_iv: "772033caf230376cd455dd2c80545e3b"
server_key_version: "encryptionkey@0"
I20260807 20:19:55.275290 19963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/wal/instance:
uuid: "f021a7a4f9dc4050a21a745348af8786"
format_stamp: "Formatted at 2026-08-07 20:19:55 on dist-test-slave-t7g5"
server_key: "dbecf8af0bfb6b9d1df71cd4da44579a"
server_key_iv: "772033caf230376cd455dd2c80545e3b"
server_key_version: "encryptionkey@0"
I20260807 20:19:55.276470 19963 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 20:19:55.277132 19990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:55.277288 19963 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:19:55.277372 19963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/wal
uuid: "f021a7a4f9dc4050a21a745348af8786"
format_stamp: "Formatted at 2026-08-07 20:19:55 on dist-test-slave-t7g5"
server_key: "dbecf8af0bfb6b9d1df71cd4da44579a"
server_key_iv: "772033caf230376cd455dd2c80545e3b"
server_key_version: "encryptionkey@0"
I20260807 20:19:55.277442 19963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:55.281571 19951 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } attempt: 2
I20260807 20:19:55.281997 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.281854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:33393 (local address 127.0.0.1:42044)
0807 20:19:55.281917 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.281961 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:33393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260807 20:19:55.282359 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.282276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:33393 (local address 127.0.0.1:42050)
0807 20:19:55.282315 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.282341 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:33393: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260807 20:19:55.282449 19951 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.253:33393: Network error: Client connection negotiation failed: client connection to 127.30.35.253:33393: connect: Connection refused (error 111)
I20260807 20:19:55.293543 19963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:55.295730 19963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:55.295873 19963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:55.299691 19963 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.253:33393
I20260807 20:19:55.299736 20069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.253:33393 every 8 connection(s)
I20260807 20:19:55.300060 19963 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/data/info.pb
I20260807 20:19:55.300859 20070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:19:55.302450 20070 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:19:55.303828 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 19963
I20260807 20:19:55.303937 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-1/wal/instance
I20260807 20:19:55.304132 30863 external_mini_cluster.cc:1428] Setting key f1c6d28521d141b737dd36fef06e7db0
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133995, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.253@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:55.311776 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.303117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43008 (local address 127.30.35.254:45549)
0807 20:19:55.303168 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.303170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.303362 (+ 192us) server_negotiation.cc:407] Connection header received
0807 20:19:55.303909 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.303910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.303926 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.303992 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.304780 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.305270 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.306442 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.306734 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.306818 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.308733 (+ 1915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.308735 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.308735 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.308751 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.310191 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.310538 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.310539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.310539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.310605 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.310900 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.310902 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.310902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.311059 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.311125 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.311566 (+ 441us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.311672 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 20:19:55.311825 20074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.303082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:45549 (local address 127.0.0.1:43008)
0807 20:19:55.303253 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.303288 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:55.303798 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:55.304083 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:55.304087 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:55.304421 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:55.304681 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.304689 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.305360 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.305361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.306353 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.306356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.306815 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.306816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.306911 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.307361 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:55.307370 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:55.308647 (+ 1277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:55.310262 (+ 1615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.310267 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.310269 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.310473 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.310685 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.310686 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.310686 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.310841 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.311128 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:55.311163 (+ 35us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:55.311352 (+ 189us) client_negotiation.cc:769] Sending connection context
0807 20:19:55.311502 (+ 150us) client_negotiation.cc:240] Negotiation successful
0807 20:19:55.311670 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":79,"threads_started":1}
I20260807 20:19:55.312374 20070 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.30.35.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.252@KRBTEST.COM" created.
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133995, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.253@KRBTEST.COM for kudu/127.30.35.253@KRBTEST.COM
I20260807 20:19:55.319365 20074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.312605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:33393 (local address 127.0.0.1:42060)
0807 20:19:55.312791 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.312801 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:55.312849 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:55.312975 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:55.312975 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:55.313113 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:55.313155 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.313157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.314085 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.314086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.314559 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.314561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.314991 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.314992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.315046 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.315441 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:55.315446 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:55.316615 (+ 1169us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:55.318366 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.318366 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.318367 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.318541 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.318749 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.318750 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.318750 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.318799 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.319113 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:55.319113 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:55.319149 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 20:19:55.319201 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 20:19:55.319302 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260807 20:19:55.319495 20076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.312674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42060 (local address 127.30.35.253:33393)
0807 20:19:55.312808 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.312812 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.312848 (+ 36us) server_negotiation.cc:407] Connection header received
0807 20:19:55.312898 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.312900 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.312913 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.312974 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.313218 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.313995 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.314620 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.314932 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.314985 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.316692 (+ 1707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.316699 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.316699 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.316705 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.318276 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.318620 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.318623 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.318623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.318688 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.318853 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.318854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.318854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.319044 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.319128 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.319247 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.319384 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":107,"thread_start_us":72,"threads_started":1}
I20260807 20:19:55.320132 20070 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:19:55.320468 20074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.320333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:34715 (local address 127.0.0.1:56048)
0807 20:19:55.320381 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.320444 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 20:19:55.320600 19991 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
I20260807 20:19:55.320998 20074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.320904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:34715 (local address 127.0.0.1:56058)
0807 20:19:55.320947 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.320976 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260807 20:19:55.321101 20070 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:34715: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.252.keytab.
Entry for principal kudu/127.30.35.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.252.keytab.
I20260807 20:19:55.331568 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.252:34715
--webserver_interface=127.30.35.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.252.keytab
--principal=kudu/127.30.35.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:43949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:45549,127.30.35.253:33393,127.30.35.252:34715
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:19:55.370326 20070 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } attempt: 1
I20260807 20:19:55.370870 20074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.370720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:34715 (local address 127.0.0.1:56062)
0807 20:19:55.370787 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.370835 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260807 20:19:55.371204 20074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.371107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:34715 (local address 127.0.0.1:56066)
0807 20:19:55.371151 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.371181 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 20:19:55.371300 20070 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:34715: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
I20260807 20:19:55.373569 19951 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } attempt: 3
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133995, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for kudu/127.30.35.253@KRBTEST.COM
I20260807 20:19:55.380395 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.373870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:33393 (local address 127.0.0.1:42072)
0807 20:19:55.373924 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.373934 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:55.373977 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:55.374117 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:55.374117 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:55.374308 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:55.374390 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.374393 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.375076 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.375077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.375901 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.375905 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.376243 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.376244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.376323 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.376739 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:55.376744 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:55.378087 (+ 1343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:55.379471 (+ 1384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.379472 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.379472 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.379638 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.379825 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.379826 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.379826 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.379883 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.380113 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:55.380115 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:55.380163 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 20:19:55.380243 (+ 80us) client_negotiation.cc:240] Negotiation successful
0807 20:19:55.380329 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 20:19:55.380672 20076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.373907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42072 (local address 127.30.35.253:33393)
0807 20:19:55.373952 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.373954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.373965 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:19:55.374033 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.374034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.374042 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.374093 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.374470 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.374995 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.375973 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.376183 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.376228 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.378168 (+ 1940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.378169 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.378170 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.378176 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.379390 (+ 1214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.379719 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.379720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.379720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.379771 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.379934 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.379934 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.379935 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.380059 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.380112 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.380514 (+ 402us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.380594 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 20:19:55.381048 19951 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:19:55.381368 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.381280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:34715 (local address 127.0.0.1:56082)
0807 20:19:55.381320 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.381348 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260807 20:19:55.381670 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.381576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:34715 (local address 127.0.0.1:56098)
0807 20:19:55.381612 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.381634 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260807 20:19:55.381745 19951 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:34715: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
I20260807 20:19:55.412868 19951 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } attempt: 1
W20260807 20:19:55.412968 20080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:55.413214 20080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:55.413256 20080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 20:19:55.413324 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.413193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:34715 (local address 127.0.0.1:56108)
0807 20:19:55.413252 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.413295 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260807 20:19:55.413622 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.413554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:34715 (local address 127.0.0.1:56122)
0807 20:19:55.413585 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.413608 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260807 20:19:55.413719 19951 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:34715: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
W20260807 20:19:55.414538 20080 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:19:55.414583 20080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:55.414602 20080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:55.414618 20080 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:19:55.414641 20080 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:19:55.416138 20080 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:43949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:45549,127.30.35.253:33393,127.30.35.252:34715
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.252.keytab
--principal=kudu/127.30.35.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.252:34715
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.35.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:55.416375 20080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:55.416574 20080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:55.420950 20092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:55.421070 20080 server_base.cc:1034] running on GCE node
W20260807 20:19:55.420930 20089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:55.420943 20090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:55.421406 20080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:55.421702 20080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:55.422856 20080 hybrid_clock.cc:648] HybridClock initialized: now 1786133995422843 us; error 23 us; skew 500 ppm
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133995, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:55.425180 20080 init.cc:377] Logged in from keytab as kudu/127.30.35.252@KRBTEST.COM (short username kudu)
I20260807 20:19:55.425603 20080 webserver.cc:460] Webserver started at http://127.30.35.252:44097/ using document root <none> and password file <none>
I20260807 20:19:55.425848 20080 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:55.425895 20080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:55.426026 20080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:19:55.427018 20080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/data/instance:
uuid: "e3f181a7391445b1acf83b1c966742ff"
format_stamp: "Formatted at 2026-08-07 20:19:55 on dist-test-slave-t7g5"
server_key: "18ddf32af699b3757b49532b8c285a9e"
server_key_iv: "eb91047b301ee6aec2e0009cc7001b71"
server_key_version: "encryptionkey@0"
I20260807 20:19:55.427337 20080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/wal/instance:
uuid: "e3f181a7391445b1acf83b1c966742ff"
format_stamp: "Formatted at 2026-08-07 20:19:55 on dist-test-slave-t7g5"
server_key: "18ddf32af699b3757b49532b8c285a9e"
server_key_iv: "eb91047b301ee6aec2e0009cc7001b71"
server_key_version: "encryptionkey@0"
I20260807 20:19:55.428586 20080 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:19:55.429243 20099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:55.429388 20080 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:19:55.429469 20080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/wal
uuid: "e3f181a7391445b1acf83b1c966742ff"
format_stamp: "Formatted at 2026-08-07 20:19:55 on dist-test-slave-t7g5"
server_key: "18ddf32af699b3757b49532b8c285a9e"
server_key_iv: "eb91047b301ee6aec2e0009cc7001b71"
server_key_version: "encryptionkey@0"
I20260807 20:19:55.429534 20080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:55.439445 20070 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } attempt: 2
I20260807 20:19:55.439811 20074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.439681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:34715 (local address 127.0.0.1:56130)
0807 20:19:55.439738 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.439777 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 20:19:55.440239 20074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.440156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:34715 (local address 127.0.0.1:56136)
0807 20:19:55.440196 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.440221 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260807 20:19:55.440333 20070 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:34715: Network error: Client connection negotiation failed: client connection to 127.30.35.252:34715: connect: Connection refused (error 111)
I20260807 20:19:55.463742 20080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:55.465857 20080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:55.465988 20080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:55.469631 20080 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.252:34715
I20260807 20:19:55.469687 20179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.252:34715 every 8 connection(s)
I20260807 20:19:55.470016 20080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/data/info.pb
I20260807 20:19:55.470808 20180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:19:55.472288 20180 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:19:55.476138 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 20080
I20260807 20:19:55.476249 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786133844183963-30863-0/minicluster-data/master-2/wal/instance
I20260807 20:19:55.476446 30863 external_mini_cluster.cc:1428] Setting key 32f7d900dcb3995f51637901a60270b4
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133995, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.252@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:55.480986 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.472938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43014 (local address 127.30.35.254:45549)
0807 20:19:55.472991 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.472992 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.473177 (+ 185us) server_negotiation.cc:407] Connection header received
0807 20:19:55.473615 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.473616 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.473624 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.473734 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.474300 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.474755 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.475650 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.475838 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.475882 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.478098 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.478099 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.478099 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.478106 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.479549 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.480017 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.480018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.480018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.480084 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.480358 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.480359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.480359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.480493 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.480567 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.480798 (+ 231us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.480875 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 20:19:55.481021 20182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.472905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:45549 (local address 127.0.0.1:43014)
0807 20:19:55.473064 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.473104 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:55.473542 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:55.473800 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:55.473804 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:55.474049 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:55.474232 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.474236 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.474814 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.474815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.475593 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.475595 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.475889 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.475889 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.475983 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.476426 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:55.476450 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:55.478004 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:55.479607 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.479612 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.479614 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.479887 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.480159 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.480160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.480160 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.480299 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.480559 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:55.480564 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:55.480675 (+ 111us) client_negotiation.cc:769] Sending connection context
0807 20:19:55.480757 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 20:19:55.480862 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":73,"threads_started":1}
I20260807 20:19:55.481603 20180 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133994, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.252@KRBTEST.COM
I20260807 20:19:55.484903 20184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.476797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56140 (local address 127.30.35.252:34715)
0807 20:19:55.476926 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.476930 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.476969 (+ 39us) server_negotiation.cc:407] Connection header received
0807 20:19:55.477037 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.477039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.477059 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.477141 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.477705 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.478495 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.479487 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.479861 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.479935 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.482332 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.482338 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.482338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.482343 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.483838 (+ 1495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.484184 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.484187 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.484187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.484248 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.484417 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.484418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.484418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.484572 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.484724 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.484770 (+ 46us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.484830 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":75,"threads_started":1}
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133995, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.252@KRBTEST.COM for kudu/127.30.35.253@KRBTEST.COM
I20260807 20:19:55.487720 20182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.481847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:33393 (local address 127.0.0.1:42076)
0807 20:19:55.481892 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.481902 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:55.481957 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:55.482075 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:55.482075 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:55.482177 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:55.482220 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.482221 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.482822 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.482823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.483523 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.483526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.483840 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.483841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.483912 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.484252 (+ 340us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:55.484256 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:55.485524 (+ 1268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:55.486899 (+ 1375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.486900 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.486900 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.487052 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.487238 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.487239 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.487239 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.487299 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.487533 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:55.487534 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:55.487563 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 20:19:55.487604 (+ 41us) client_negotiation.cc:240] Negotiation successful
0807 20:19:55.487666 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 20:19:55.487794 20076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.481926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42076 (local address 127.30.35.253:33393)
0807 20:19:55.481977 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.481979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.481988 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:19:55.482012 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.482013 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.482022 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.482075 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.482282 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.482750 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.483597 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.483777 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.483826 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.485598 (+ 1772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.485599 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.485600 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.485607 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.486827 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.487112 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.487113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.487113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.487174 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.487354 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.487355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.487355 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.487480 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.487541 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.487635 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.487706 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 20:19:55.488107 20180 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:19:55.488849 19951 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } attempt: 2
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133994, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133995, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.252@KRBTEST.COM for kudu/127.30.35.252@KRBTEST.COM
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133995, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for kudu/127.30.35.252@KRBTEST.COM
I20260807 20:19:55.493278 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.485593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43022 (local address 127.30.35.254:45549)
0807 20:19:55.485625 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.485627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.485751 (+ 124us) server_negotiation.cc:407] Connection header received
0807 20:19:55.485815 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.485816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.485823 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.485877 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.486379 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.486825 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.488077 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.488301 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.488361 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.490746 (+ 2385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.490747 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.490747 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.490754 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.492164 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.492456 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.492457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.492458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.492510 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.492697 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.492698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.492699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.492818 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.492944 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.493121 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.493195 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260807 20:19:55.495510 20182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.488315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:34715 (local address 127.0.0.1:56146)
0807 20:19:55.488354 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.488363 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:55.488397 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:55.488499 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:55.488500 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:55.488602 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:55.488634 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.488635 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.489804 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.489805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.490253 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.490254 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.490688 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.490690 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.490736 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.491073 (+ 337us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:55.491077 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:55.492307 (+ 1230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:55.494527 (+ 2220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.494529 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.494529 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.494705 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.494898 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.494898 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.494899 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.494960 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.495206 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:55.495207 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:55.495246 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 20:19:55.495306 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 20:19:55.495400 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260807 20:19:55.495577 20184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.488357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56146 (local address 127.30.35.252:34715)
0807 20:19:55.488391 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.488393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.488401 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:19:55.488439 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.488440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.488449 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.488498 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.488696 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.489717 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.490319 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.490605 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.490852 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.492389 (+ 1537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.492390 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.492390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.492396 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.494453 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.494761 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.494763 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.494763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.494822 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.495023 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.495023 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.495024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.495143 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.495201 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.495333 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.495479 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":70,"server-negotiator.queue_time_us":17}
I20260807 20:19:55.496388 20185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.489145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56158 (local address 127.30.35.252:34715)
0807 20:19:55.489278 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.489279 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.489284 (+ 5us) server_negotiation.cc:407] Connection header received
0807 20:19:55.489297 (+ 13us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.489298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.489304 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.489356 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.489597 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.490336 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.491102 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.491395 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.491493 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.493538 (+ 2045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.493539 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.493540 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.493545 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.495262 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.495655 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.495656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.495656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.495713 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.495909 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.495910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.495910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.496037 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.496096 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.496248 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.496306 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":89,"threads_started":1}
I20260807 20:19:55.496390 19954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.489084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:34715 (local address 127.0.0.1:56158)
0807 20:19:55.489131 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.489141 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:55.489175 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:55.489372 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:55.489373 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:55.489504 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:55.489534 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.489535 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.490438 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.490439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.491034 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.491037 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.491716 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.491717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.491782 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.492143 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:55.492148 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:55.493424 (+ 1276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:55.495351 (+ 1927us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.495352 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.495353 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.495577 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.495765 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.495766 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.495766 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.495836 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.496107 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:55.496108 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:55.496152 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 20:19:55.496231 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 20:19:55.496311 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 20:19:55.496963 20180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff: Bootstrap starting.
I20260807 20:19:55.497495 20180 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff: Neither blocks nor log segments found. Creating new log.
I20260807 20:19:55.497539 19951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5: Bootstrap starting.
I20260807 20:19:55.497797 20180 log.cc:824] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff: Log is configured to *not* fsync() on all Append() calls
I20260807 20:19:55.498234 19951 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5: Neither blocks nor log segments found. Creating new log.
I20260807 20:19:55.498517 19951 log.cc:824] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5: Log is configured to *not* fsync() on all Append() calls
I20260807 20:19:55.498592 20180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff: No bootstrap required, opened a new log
I20260807 20:19:55.499137 19951 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5: No bootstrap required, opened a new log
I20260807 20:19:55.500540 20180 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } }
I20260807 20:19:55.500680 20180 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:19:55.500587 19951 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } }
I20260807 20:19:55.500713 20180 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f181a7391445b1acf83b1c966742ff, State: Initialized, Role: FOLLOWER
I20260807 20:19:55.500716 19951 raft_consensus.cc:374] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:19:55.500751 19951 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41a86c9cd48b4e23bed41a961ac451e5, State: Initialized, Role: FOLLOWER
I20260807 20:19:55.500833 20180 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } }
I20260807 20:19:55.500912 19951 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } }
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133994, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.253@KRBTEST.COM
I20260807 20:19:55.501143 20180 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:19:55.501223 19951 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:19:55.501308 20190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } } }
I20260807 20:19:55.501471 20190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 20:19:55.503113 20219 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:19:55.503166 20219 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:19:55.504987 20076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.494373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42088 (local address 127.30.35.253:33393)
0807 20:19:55.494408 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.494410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.494418 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:19:55.494447 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.494448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.494457 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.494507 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.495052 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.495725 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.498731 (+ 3006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.498987 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.499029 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.501630 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.501631 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.501632 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.501639 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.503433 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.503825 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.503827 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.503827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.503885 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.504080 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.504081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.504081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.504187 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.504819 (+ 632us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.504864 (+ 45us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.504928 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 20:19:55.503921 19855 master_runner.cc:186] Error getting master registration for 127.30.35.253:33393: OK, instance_id { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" instance_seqno: 1786133995298656 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 20:19:55.506712 19855 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 20:19:55.504319 20080 master_runner.cc:186] Error getting master registration for 127.30.35.253:33393: OK, instance_id { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" instance_seqno: 1786133995298656 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 20:19:55.507056 20080 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 20:19:55.508383 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260807 20:19:55.510272 20220 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:19:55.510319 20220 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:19:55.510421 20189 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } } }
I20260807 20:19:55.510499 20189 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:19:55.518891 20185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.510233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56160 (local address 127.30.35.252:34715)
0807 20:19:55.510415 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.510417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.510768 (+ 351us) server_negotiation.cc:407] Connection header received
0807 20:19:55.510791 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.510791 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.510803 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.510848 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.511465 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.512191 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.513171 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.513498 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.513541 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.515090 (+ 1549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.515091 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.515091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.515098 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.516892 (+ 1794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.517744 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.517746 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.517746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.517811 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.518283 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.518284 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.518285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.518420 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.518506 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.518718 (+ 212us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.518802 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163}
I20260807 20:19:55.521831 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.510198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43032 (local address 127.30.35.254:45549)
0807 20:19:55.510269 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.510270 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.510278 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:19:55.510297 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.510298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.510307 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.510369 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.511782 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.512489 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.515175 (+ 2686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.515490 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.515531 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.517296 (+ 1765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.517297 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.517298 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.517305 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.518790 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.519634 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.519635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.519636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.519690 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.520189 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.520190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.520190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.520312 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.520399 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.521646 (+ 1247us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.521740 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 20:19:55.523283 20076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.509978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42104 (local address 127.30.35.253:33393)
0807 20:19:55.510013 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.510015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.510649 (+ 634us) server_negotiation.cc:407] Connection header received
0807 20:19:55.510707 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.510708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.510718 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.510763 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.513497 (+ 2734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.514226 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.515864 (+ 1638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.516148 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.516187 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.519765 (+ 3578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.519767 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.519767 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.519773 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.521538 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.522431 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.522433 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.522433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.522494 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.522688 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.522689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.522690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.522806 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.522870 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.523092 (+ 222us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.523170 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 20:19:55.531486 20070 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } attempt: 3
Aug 07 20:19:55 dist-test-slave-t7g5 krb5kdc[19835](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133995, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.253@KRBTEST.COM for kudu/127.30.35.252@KRBTEST.COM
I20260807 20:19:55.539356 20074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.531750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:34715 (local address 127.0.0.1:56172)
0807 20:19:55.531806 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:55.531816 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:55.531854 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:55.532012 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:55.532012 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:55.532173 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:55.532219 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.532221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.533174 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.533175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.534022 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:55.534024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.534476 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.534477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:55.534535 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.534971 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:55.534975 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:55.536457 (+ 1482us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:55.538321 (+ 1864us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.538322 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.538323 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.538540 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.538736 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:55.538736 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:55.538737 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:55.538804 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:55.539044 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:55.539044 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:55.539090 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 20:19:55.539159 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 20:19:55.539256 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 20:19:55.539356 20185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:55.531820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56172 (local address 127.30.35.252:34715)
0807 20:19:55.531858 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:55.531860 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:55.531870 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:19:55.531913 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:55.531914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:55.531922 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:55.531998 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:55.532289 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.533094 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.534096 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:55.534396 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:55.534462 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:55.536544 (+ 2082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:55.536545 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:55.536546 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:55.536553 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:55.538238 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.538618 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.538619 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.538619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.538678 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:55.538864 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:55.538864 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:55.538864 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:55.538985 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:55.539048 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:55.539189 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 20:19:55.539264 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 20:19:55.541322 20070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786: Bootstrap starting.
I20260807 20:19:55.542110 20070 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786: Neither blocks nor log segments found. Creating new log.
I20260807 20:19:55.542421 20070 log.cc:824] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786: Log is configured to *not* fsync() on all Append() calls
I20260807 20:19:55.543299 20070 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786: No bootstrap required, opened a new log
I20260807 20:19:55.545274 20070 raft_consensus.cc:348] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } }
I20260807 20:19:55.545429 20070 raft_consensus.cc:374] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:19:55.545465 20070 raft_consensus.cc:729] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f021a7a4f9dc4050a21a745348af8786, State: Initialized, Role: FOLLOWER
I20260807 20:19:55.545589 20070 consensus_queue.cc:260] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } }
I20260807 20:19:55.545931 20070 sys_catalog.cc:564] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:19:55.545888 20239 sys_catalog.cc:455] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } } }
I20260807 20:19:55.546077 20239 sys_catalog.cc:458] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 20:19:55.546437 19998 tablet.cc:2369] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:19:55.547736 20255 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:19:55.547842 20255 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:19:55.549861 19963 master_runner.cc:263] No leader master found from master f021a7a4f9dc4050a21a745348af8786
I20260807 20:19:55.549916 19963 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 20:19:55.646126 19881 tablet.cc:2369] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:19:55.716580 20109 tablet.cc:2369] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:19:55.726914 20189 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:19:55.727048 20189 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } }
I20260807 20:19:55.727310 20189 leader_election.cc:288] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41a86c9cd48b4e23bed41a961ac451e5 (127.30.35.254:45549), f021a7a4f9dc4050a21a745348af8786 (127.30.35.253:33393)
I20260807 20:19:55.727641 19908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e3f181a7391445b1acf83b1c966742ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41a86c9cd48b4e23bed41a961ac451e5" is_pre_election: true
I20260807 20:19:55.727663 20029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e3f181a7391445b1acf83b1c966742ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f021a7a4f9dc4050a21a745348af8786" is_pre_election: true
I20260807 20:19:55.727818 20029 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f181a7391445b1acf83b1c966742ff in term 0.
I20260807 20:19:55.727819 19908 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3f181a7391445b1acf83b1c966742ff in term 0.
I20260807 20:19:55.728050 20100 leader_election.cc:302] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41a86c9cd48b4e23bed41a961ac451e5, e3f181a7391445b1acf83b1c966742ff; no voters:
I20260807 20:19:55.728194 20189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:19:55.728262 20189 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:19:55.728284 20189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:19:55.729056 20189 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } }
I20260807 20:19:55.729179 20189 leader_election.cc:288] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [CANDIDATE]: Term 1 election: Requested vote from peers 41a86c9cd48b4e23bed41a961ac451e5 (127.30.35.254:45549), f021a7a4f9dc4050a21a745348af8786 (127.30.35.253:33393)
I20260807 20:19:55.729337 20029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e3f181a7391445b1acf83b1c966742ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f021a7a4f9dc4050a21a745348af8786"
I20260807 20:19:55.729346 19908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e3f181a7391445b1acf83b1c966742ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41a86c9cd48b4e23bed41a961ac451e5"
I20260807 20:19:55.729431 20029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:19:55.729434 19908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:19:55.730301 20029 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f181a7391445b1acf83b1c966742ff in term 1.
I20260807 20:19:55.730301 19908 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3f181a7391445b1acf83b1c966742ff in term 1.
I20260807 20:19:55.730502 20100 leader_election.cc:302] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41a86c9cd48b4e23bed41a961ac451e5, e3f181a7391445b1acf83b1c966742ff; no voters:
I20260807 20:19:55.730769 20189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:19:55.730962 20189 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [term 1 LEADER]: Becoming Leader. State: Replica: e3f181a7391445b1acf83b1c966742ff, State: Running, Role: LEADER
I20260807 20:19:55.731060 20189 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } }
I20260807 20:19:55.731454 20257 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3f181a7391445b1acf83b1c966742ff. Latest consensus state: current_term: 1 leader_uuid: "e3f181a7391445b1acf83b1c966742ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } } }
I20260807 20:19:55.731526 20257 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [sys.catalog]: This master's current role is: LEADER
I20260807 20:19:55.731752 20260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:19:55.731936 20260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:19:55.733273 20029 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [term 1 FOLLOWER]: Refusing update from remote peer e3f181a7391445b1acf83b1c966742ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:19:55.733299 19908 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [term 1 FOLLOWER]: Refusing update from remote peer e3f181a7391445b1acf83b1c966742ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:19:55.733572 20189 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:19:55.733704 20257 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:19:55.734740 20239 sys_catalog.cc:455] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3f181a7391445b1acf83b1c966742ff. Latest consensus state: current_term: 1 leader_uuid: "e3f181a7391445b1acf83b1c966742ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } } }
I20260807 20:19:55.734848 20239 sys_catalog.cc:458] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:19:55.735559 20261 mvcc.cc:205] Tried to move back new op lower bound from 7316004846521339904 to 7316004846514974720. Current Snapshot: MvccSnapshot[applied={T|T < 7316004846521339904}]
I20260807 20:19:55.735674 20257 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e3f181a7391445b1acf83b1c966742ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } } }
I20260807 20:19:55.735703 20190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3f181a7391445b1acf83b1c966742ff. Latest consensus state: current_term: 1 leader_uuid: "e3f181a7391445b1acf83b1c966742ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } } }
I20260807 20:19:55.735751 20257 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [sys.catalog]: This master's current role is: LEADER
I20260807 20:19:55.735772 20190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:19:55.735821 20239 sys_catalog.cc:455] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e3f181a7391445b1acf83b1c966742ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } } }
I20260807 20:19:55.735900 20239 sys_catalog.cc:458] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:19:55.735962 20262 mvcc.cc:205] Tried to move back new op lower bound from 7316004846521339904 to 7316004846514974720. Current Snapshot: MvccSnapshot[applied={T|T < 7316004846521339904}]
I20260807 20:19:55.736188 20260 catalog_manager.cc:1347] Generated new cluster ID: 0ffced1956444c3aa19f12a3ad723552
I20260807 20:19:55.736239 20260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:19:55.736668 20257 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e3f181a7391445b1acf83b1c966742ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } } }
I20260807 20:19:55.736742 20257 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff [sys.catalog]: This master's current role is: LEADER
I20260807 20:19:55.736974 20190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e3f181a7391445b1acf83b1c966742ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41a86c9cd48b4e23bed41a961ac451e5" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45549 } } peers { permanent_uuid: "f021a7a4f9dc4050a21a745348af8786" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 33393 } } peers { permanent_uuid: "e3f181a7391445b1acf83b1c966742ff" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 34715 } } }
I20260807 20:19:55.737054 20190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:19:55.755596 20260 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:19:55.756218 20260 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:19:55.765743 20260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3f181a7391445b1acf83b1c966742ff: Generated new TSK 0
I20260807 20:19:55.765972 20260 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:19:56.510762 20220 catalog_manager.cc:1259] Loaded cluster ID: 0ffced1956444c3aa19f12a3ad723552
I20260807 20:19:56.510838 20220 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5: loading cluster ID for follower catalog manager: success
I20260807 20:19:56.511605 20220 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5: acquiring CA information for follower catalog manager: success
I20260807 20:19:56.511878 20220 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 41a86c9cd48b4e23bed41a961ac451e5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 20:19:56.548302 20255 catalog_manager.cc:1259] Loaded cluster ID: 0ffced1956444c3aa19f12a3ad723552
I20260807 20:19:56.548385 20255 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786: loading cluster ID for follower catalog manager: success
I20260807 20:19:56.549155 20255 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786: acquiring CA information for follower catalog manager: success
I20260807 20:19:56.549427 20255 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f021a7a4f9dc4050a21a745348af8786: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 20:19:56.817124 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 19855
I20260807 20:19:56.828855 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 19963
I20260807 20:19:56.844956 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 20080
2026-08-07T20:19:56Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3072 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:19:56 dist-test-slave-t7g5 krb5kdc[20281](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:19:56 dist-test-slave-t7g5 krb5kdc[20281](info): set up 2 sockets
Aug 07 20:19:56 dist-test-slave-t7g5 krb5kdc[20281](info): commencing operation
krb5kdc: starting...
W20260807 20:19:57.971201 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:19:58 dist-test-slave-t7g5 krb5kdc[20281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133998, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:19:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:19:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:19:58.088749 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:37773
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:35767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:37773
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:19:58.167832 20299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:58.168028 20299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:58.168057 20299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:58.169157 20299 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:19:58.169195 20299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:58.169212 20299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:58.169229 20299 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:19:58.169243 20299 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:19:58.170706 20299 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:35767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:37773
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:37773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:58.170939 20299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:58.171134 20299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:58.175952 20309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:58.176057 20307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:58.175973 20305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:58.176367 20299 server_base.cc:1034] running on GCE node
I20260807 20:19:58.176605 20299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:58.176853 20299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:58.177987 20299 hybrid_clock.cc:648] HybridClock initialized: now 1786133998177970 us; error 34 us; skew 500 ppm
Aug 07 20:19:58 dist-test-slave-t7g5 krb5kdc[20281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133998, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:58.180343 20299 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:19:58.180743 20299 webserver.cc:460] Webserver started at http://127.30.35.254:43821/ using document root <none> and password file <none>
I20260807 20:19:58.180922 20299 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:58.180959 20299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:58.181048 20299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:19:58.182042 20299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "5185edc47c9d46b0917fb281f890992d"
format_stamp: "Formatted at 2026-08-07 20:19:58 on dist-test-slave-t7g5"
server_key: "152d8c33c5793440a371d0fbbf4fdacd"
server_key_iv: "894799973db9ac3027dadb0759a51709"
server_key_version: "encryptionkey@0"
I20260807 20:19:58.182329 20299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "5185edc47c9d46b0917fb281f890992d"
format_stamp: "Formatted at 2026-08-07 20:19:58 on dist-test-slave-t7g5"
server_key: "152d8c33c5793440a371d0fbbf4fdacd"
server_key_iv: "894799973db9ac3027dadb0759a51709"
server_key_version: "encryptionkey@0"
I20260807 20:19:58.183460 20299 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:19:58.184098 20321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:58.184254 20299 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:19:58.184332 20299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "5185edc47c9d46b0917fb281f890992d"
format_stamp: "Formatted at 2026-08-07 20:19:58 on dist-test-slave-t7g5"
server_key: "152d8c33c5793440a371d0fbbf4fdacd"
server_key_iv: "894799973db9ac3027dadb0759a51709"
server_key_version: "encryptionkey@0"
I20260807 20:19:58.184396 20299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:58.202180 20299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:58.203904 20299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:58.204015 20299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:58.207736 20299 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:37773
I20260807 20:19:58.207767 20392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:37773 every 8 connection(s)
I20260807 20:19:58.208078 20299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:19:58.208907 20393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:19:58.211169 20393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d: Bootstrap starting.
I20260807 20:19:58.211710 20393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d: Neither blocks nor log segments found. Creating new log.
I20260807 20:19:58.211978 20393 log.cc:824] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d: Log is configured to *not* fsync() on all Append() calls
I20260807 20:19:58.212647 20393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d: No bootstrap required, opened a new log
I20260807 20:19:58.213256 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 20299
I20260807 20:19:58.213370 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:19:58.213584 30863 external_mini_cluster.cc:1428] Setting key 3f07a619ef531e6a895bfad19565f0e7
I20260807 20:19:58.214658 20393 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5185edc47c9d46b0917fb281f890992d" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37773 } }
I20260807 20:19:58.214799 20393 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:19:58.214830 20393 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5185edc47c9d46b0917fb281f890992d, State: Initialized, Role: FOLLOWER
I20260807 20:19:58.214974 20393 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5185edc47c9d46b0917fb281f890992d" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37773 } }
I20260807 20:19:58.215052 20393 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:19:58.215083 20393 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:19:58.215130 20393 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:19:58.216197 20393 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5185edc47c9d46b0917fb281f890992d" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37773 } }
I20260807 20:19:58.216308 20393 leader_election.cc:302] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5185edc47c9d46b0917fb281f890992d; no voters:
I20260807 20:19:58.216477 20393 leader_election.cc:288] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:19:58.216516 20399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:19:58.216620 20399 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [term 1 LEADER]: Becoming Leader. State: Replica: 5185edc47c9d46b0917fb281f890992d, State: Running, Role: LEADER
I20260807 20:19:58.216739 20393 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:19:58.216792 20399 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5185edc47c9d46b0917fb281f890992d" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37773 } }
I20260807 20:19:58.217160 20399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5185edc47c9d46b0917fb281f890992d. Latest consensus state: current_term: 1 leader_uuid: "5185edc47c9d46b0917fb281f890992d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5185edc47c9d46b0917fb281f890992d" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37773 } } }
I20260807 20:19:58.217293 20399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [sys.catalog]: This master's current role is: LEADER
I20260807 20:19:58.218106 20409 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:19:58.218217 20400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5185edc47c9d46b0917fb281f890992d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5185edc47c9d46b0917fb281f890992d" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 37773 } } }
I20260807 20:19:58.218287 20400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d [sys.catalog]: This master's current role is: LEADER
I20260807 20:19:58.218613 20409 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:19:58.220083 20409 catalog_manager.cc:1347] Generated new cluster ID: 4f12816f4ff045e3824e94479e6e871b
I20260807 20:19:58.220136 20409 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:19:58 dist-test-slave-t7g5 krb5kdc[20281](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133998, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:58.225808 20397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:58.214120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53802 (local address 127.30.35.254:37773)
0807 20:19:58.214279 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:58.214287 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:58.214313 (+ 26us) server_negotiation.cc:407] Connection header received
0807 20:19:58.214655 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:58.214664 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:58.214717 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:58.214879 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:58.215669 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:58.216994 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:58.218025 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:58.218596 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:58.218712 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:58.221682 (+ 2970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:58.221686 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:58.221686 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:58.221698 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:58.223567 (+ 1869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:58.223952 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:58.223955 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:58.223955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:58.224668 (+ 713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:58.224889 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:58.224889 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:58.224890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:58.225179 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:58.225322 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:58.225452 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 20:19:58.225580 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
I20260807 20:19:58.226804 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:19:58.246774 20409 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:19:58.247556 20409 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:19:58.256939 20409 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5185edc47c9d46b0917fb281f890992d: Generated new TSK 0
I20260807 20:19:58.257143 20409 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:19:58.280500 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 20299
2026-08-07T20:19:58Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1439 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:19:58 dist-test-slave-t7g5 krb5kdc[20430](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:19:58 dist-test-slave-t7g5 krb5kdc[20430](info): set up 2 sockets
Aug 07 20:19:58 dist-test-slave-t7g5 krb5kdc[20430](info): commencing operation
krb5kdc: starting...
W20260807 20:19:59.424181 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:19:59 dist-test-slave-t7g5 krb5kdc[20430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:19:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:19:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:19:59.544912 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:39129
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:39129
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:19:59.625289 20448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:59.625504 20448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:59.625525 20448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:59.626636 20448 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:19:59.626674 20448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:59.626686 20448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:59.626698 20448 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:19:59.626708 20448 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:19:59.628108 20448 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:39129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:39129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:59.628304 20448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:59.628475 20448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:59.633072 20453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:59.633083 20456 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:59.633157 20448 server_base.cc:1034] running on GCE node
W20260807 20:19:59.633083 20454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:59.633548 20448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:59.633846 20448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:59.634995 20448 hybrid_clock.cc:648] HybridClock initialized: now 1786133999634976 us; error 30 us; skew 500 ppm
Aug 07 20:19:59 dist-test-slave-t7g5 krb5kdc[20430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133999, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:59.637725 20448 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:19:59.638162 20448 webserver.cc:460] Webserver started at http://127.30.35.254:34989/ using document root <none> and password file <none>
I20260807 20:19:59.638361 20448 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:59.638408 20448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:59.638538 20448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:19:59.639603 20448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "c3ccce47d0394c0883adf6996bdc19b9"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "056e485b63899ea752f6e84af959b362"
server_key_iv: "0230cc6fab1030e583f2c5d9218c1cff"
server_key_version: "encryptionkey@0"
I20260807 20:19:59.639941 20448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "c3ccce47d0394c0883adf6996bdc19b9"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "056e485b63899ea752f6e84af959b362"
server_key_iv: "0230cc6fab1030e583f2c5d9218c1cff"
server_key_version: "encryptionkey@0"
I20260807 20:19:59.641167 20448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:19:59.641834 20469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:59.641975 20448 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:19:59.642061 20448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "c3ccce47d0394c0883adf6996bdc19b9"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "056e485b63899ea752f6e84af959b362"
server_key_iv: "0230cc6fab1030e583f2c5d9218c1cff"
server_key_version: "encryptionkey@0"
I20260807 20:19:59.642124 20448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:59.653844 20448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:59.655678 20448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:59.655808 20448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:59.659561 20448 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:39129
I20260807 20:19:59.659603 20538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:39129 every 8 connection(s)
I20260807 20:19:59.659941 20448 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:19:59.660894 20539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:19:59.663204 20539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Bootstrap starting.
I20260807 20:19:59.663761 20539 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Neither blocks nor log segments found. Creating new log.
I20260807 20:19:59.664033 20539 log.cc:824] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Log is configured to *not* fsync() on all Append() calls
I20260807 20:19:59.664692 20539 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: No bootstrap required, opened a new log
I20260807 20:19:59.666353 20539 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } }
I20260807 20:19:59.666503 20539 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:19:59.666527 20539 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3ccce47d0394c0883adf6996bdc19b9, State: Initialized, Role: FOLLOWER
I20260807 20:19:59.666656 20539 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } }
I20260807 20:19:59.666720 20539 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:19:59.666740 20539 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:19:59.666769 20539 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:19:59.667565 20539 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } }
I20260807 20:19:59.667659 20539 leader_election.cc:302] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3ccce47d0394c0883adf6996bdc19b9; no voters:
I20260807 20:19:59.667814 20539 leader_election.cc:288] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:19:59.667855 20542 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:19:59.668004 20542 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 1 LEADER]: Becoming Leader. State: Replica: c3ccce47d0394c0883adf6996bdc19b9, State: Running, Role: LEADER
I20260807 20:19:59.668077 20539 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:19:59.668109 20542 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } }
I20260807 20:19:59.668463 20543 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3ccce47d0394c0883adf6996bdc19b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } } }
I20260807 20:19:59.668561 20543 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: This master's current role is: LEADER
I20260807 20:19:59.668473 20545 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3ccce47d0394c0883adf6996bdc19b9. Latest consensus state: current_term: 1 leader_uuid: "c3ccce47d0394c0883adf6996bdc19b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } } }
I20260807 20:19:59.668646 20545 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: This master's current role is: LEADER
I20260807 20:19:59.669083 20552 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:19:59.669592 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 20448
I20260807 20:19:59.669603 20552 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:19:59.669735 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:19:59.669956 30863 external_mini_cluster.cc:1428] Setting key 2f44627149a3b48d78dcc260d3739948
I20260807 20:19:59.671916 20552 catalog_manager.cc:1347] Generated new cluster ID: 9efe31ee6cbf4b57b114623de6bc208a
I20260807 20:19:59.671977 20552 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:19:59 dist-test-slave-t7g5 krb5kdc[20430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133999, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:59.679678 20570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:59.670449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56014 (local address 127.30.35.254:39129)
0807 20:19:59.671054 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:59.671063 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:59.671095 (+ 32us) server_negotiation.cc:407] Connection header received
0807 20:19:59.671212 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:59.671220 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:59.671276 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:59.671412 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:59.672115 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:59.673069 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:59.673826 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:59.674251 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:59.674350 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:59.676559 (+ 2209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:59.676564 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:59.676564 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:59.676578 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:59.678164 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:59.678492 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:59.678495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:59.678495 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:59.678594 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:59.678774 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:59.678775 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:59.678775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:59.679021 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:59.679171 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:59.679274 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 20:19:59.679506 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":554,"thread_start_us":78,"threads_started":1}
I20260807 20:19:59.699002 20552 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:19:59.699783 20552 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:19:59.707806 20552 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Generated new TSK 0
I20260807 20:19:59.708031 20552 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:19:59.740326 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:39129
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:19:59.822372 20575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:59.822587 20575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:59.822618 20575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:59.823724 20575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:59.823764 20575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:59.823798 20575 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:19:59.825253 20575 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:59.825487 20575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:59.825729 20575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:59.830734 20586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:59.830729 20584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:59.830725 20582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:59.830971 20575 server_base.cc:1034] running on GCE node
I20260807 20:19:59.831164 20575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:59.831398 20575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:59.832541 20575 hybrid_clock.cc:648] HybridClock initialized: now 1786133999832529 us; error 25 us; skew 500 ppm
Aug 07 20:19:59 dist-test-slave-t7g5 krb5kdc[20430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133999, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:59.834964 20575 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:19:59.835412 20575 webserver.cc:460] Webserver started at http://127.30.35.193:45307/ using document root <none> and password file <none>
I20260807 20:19:59.835624 20575 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:59.835667 20575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:59.835793 20575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:19:59.836882 20575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "9d91932229d9420e8fe47f721d34e7f4"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "6c05bf9e24f43020755671ce51ce7e8f"
server_key_iv: "13bdfa7cc68bcf328e49807c2a4ab77a"
server_key_version: "encryptionkey@0"
I20260807 20:19:59.837205 20575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "9d91932229d9420e8fe47f721d34e7f4"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "6c05bf9e24f43020755671ce51ce7e8f"
server_key_iv: "13bdfa7cc68bcf328e49807c2a4ab77a"
server_key_version: "encryptionkey@0"
I20260807 20:19:59.838523 20575 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:19:59.839149 20596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:59.839318 20575 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:59.839401 20575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "9d91932229d9420e8fe47f721d34e7f4"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "6c05bf9e24f43020755671ce51ce7e8f"
server_key_iv: "13bdfa7cc68bcf328e49807c2a4ab77a"
server_key_version: "encryptionkey@0"
I20260807 20:19:59.839457 20575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:59.852459 20575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:19:59.854302 20575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:19:59.854417 20575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:19:59.854612 20575 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:19:59.854882 20575 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:19:59.854912 20575 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:59.854933 20575 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:19:59.854957 20575 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:59.860527 20575 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:38763
I20260807 20:19:59.860598 20755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:38763 every 8 connection(s)
I20260807 20:19:59.860888 20575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:19:59.865826 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 20575
I20260807 20:19:59.865944 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:19:59.866161 30863 external_mini_cluster.cc:1428] Setting key 462f95b40ede1a0a5f7c5be47be454a5
Aug 07 20:19:59 dist-test-slave-t7g5 krb5kdc[20430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133999, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:19:59.870188 20570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:59.861598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:49183 (local address 127.30.35.254:39129)
0807 20:19:59.861681 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0807 20:19:59.861683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:19:59.861877 (+ 194us) server_negotiation.cc:407] Connection header received
0807 20:19:59.862365 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:19:59.862366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:19:59.862378 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:19:59.862437 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:19:59.863336 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:59.863834 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:59.864780 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:19:59.864962 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:19:59.865005 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:59.867333 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:19:59.867335 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:19:59.867335 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:19:59.867342 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:19:59.868751 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:59.869191 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:59.869192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:59.869192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:59.869242 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:19:59.869533 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:19:59.869533 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:19:59.869534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:19:59.869644 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:19:59.869718 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:19:59.870014 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 20:19:59.870103 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 20:19:59.870256 20760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:19:59.861554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:49183)
0807 20:19:59.861749 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 20:19:59.861792 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 20:19:59.862287 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:19:59.862510 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:19:59.862513 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:19:59.863073 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:19:59.863269 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:59.863274 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:59.863912 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:59.863913 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:59.864720 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:19:59.864722 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:19:59.865016 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:19:59.865016 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:19:59.865114 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:19:59.865624 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:19:59.865635 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:19:59.867246 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:19:59.868822 (+ 1576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:59.868831 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:59.868833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:59.869123 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:59.869321 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:19:59.869322 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:19:59.869322 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:19:59.869472 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:19:59.869746 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:19:59.869753 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:19:59.869873 (+ 120us) client_negotiation.cc:769] Sending connection context
0807 20:19:59.869963 (+ 90us) client_negotiation.cc:240] Negotiation successful
0807 20:19:59.870087 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":121,"threads_started":1}
I20260807 20:19:59.870740 20756 heartbeater.cc:347] Connected to a master server at 127.30.35.254:39129
I20260807 20:19:59.870838 20756 heartbeater.cc:464] Registering TS with master...
I20260807 20:19:59.871016 20756 heartbeater.cc:511] Master 127.30.35.254:39129 requested a full tablet report, sending...
I20260807 20:19:59.871624 20492 ts_manager.cc:194] Registered new tserver with Master: 9d91932229d9420e8fe47f721d34e7f4 (127.30.35.193:38763)
I20260807 20:19:59.872499 20492 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:49183
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:19:59.893471 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:39129
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:19:59.974617 20764 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:19:59.974845 20764 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:19:59.974879 20764 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:19:59.976042 20764 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:19:59.976085 20764 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:19:59.976120 20764 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:19:59.977545 20764 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20764
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:19:59.977819 20764 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:19:59.978031 20764 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:19:59.982788 20772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:19:59.982839 20774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:59.983032 20764 server_base.cc:1034] running on GCE node
W20260807 20:19:59.982836 20771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:19:59.983299 20764 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:19:59.983560 20764 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:19:59.984704 20764 hybrid_clock.cc:648] HybridClock initialized: now 1786133999984690 us; error 29 us; skew 500 ppm
Aug 07 20:19:59 dist-test-slave-t7g5 krb5kdc[20430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133999, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:19:59.987227 20764 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:19:59.987637 20764 webserver.cc:460] Webserver started at http://127.30.35.194:37027/ using document root <none> and password file <none>
I20260807 20:19:59.987838 20764 fs_manager.cc:359] Metadata directory not provided
I20260807 20:19:59.987886 20764 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:19:59.988023 20764 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:19:59.989080 20764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "0cb8ce06a9494109af547519d87c4088"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "fc878d58a1d3f8dbf064591c71d08c87"
server_key_iv: "1d30b46c565d45b48f4fdb8135cb1dc0"
server_key_version: "encryptionkey@0"
I20260807 20:19:59.989374 20764 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "0cb8ce06a9494109af547519d87c4088"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "fc878d58a1d3f8dbf064591c71d08c87"
server_key_iv: "1d30b46c565d45b48f4fdb8135cb1dc0"
server_key_version: "encryptionkey@0"
I20260807 20:19:59.990609 20764 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 20:19:59.991261 20784 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:59.991413 20764 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:19:59.991500 20764 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "0cb8ce06a9494109af547519d87c4088"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "fc878d58a1d3f8dbf064591c71d08c87"
server_key_iv: "1d30b46c565d45b48f4fdb8135cb1dc0"
server_key_version: "encryptionkey@0"
I20260807 20:19:59.991564 20764 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:19:59.999747 20764 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:00.001478 20764 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:00.001616 20764 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:00.001847 20764 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:20:00.002140 20764 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:20:00.002174 20764 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:00.002204 20764 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:20:00.002221 20764 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:00.007797 20764 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:41181
I20260807 20:20:00.007866 20952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:41181 every 8 connection(s)
I20260807 20:20:00.008162 20764 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:20:00.008481 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 20764
I20260807 20:20:00.008594 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:20:00.008805 30863 external_mini_cluster.cc:1428] Setting key d6ada7728bf9d2f1da4e73365bfaa6ad
Aug 07 20:20:00 dist-test-slave-t7g5 krb5kdc[20430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786133999, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
I20260807 20:20:00.018393 20570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.009143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:48965 (local address 127.30.35.254:39129)
0807 20:20:00.009187 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:00.009189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:00.009232 (+ 43us) server_negotiation.cc:407] Connection header received
0807 20:20:00.009839 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:00.009840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:00.009852 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:00.009915 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:00.010863 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.011539 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.012892 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.013074 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.013114 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.015603 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:00.015605 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:00.015605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:00.015612 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:00.016913 (+ 1301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:00.017380 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:00.017381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:00.017381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:00.017428 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:00.017721 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:00.017722 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:00.017722 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:00.017846 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:00.017900 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:00.018246 (+ 346us) server_negotiation.cc:299] Negotiation successful
0807 20:20:00.018323 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:20:00.018611 20956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.008842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:48965)
0807 20:20:00.009114 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:00.009164 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:00.009749 (+ 585us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:00.009980 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:00.009983 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:00.010570 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:00.010772 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.010777 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.011634 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.011636 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.012812 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.012816 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.013142 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.013144 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.013285 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.013826 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:00.013837 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:00.015493 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:00.016998 (+ 1505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:00.017006 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:00.017009 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:00.017305 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:00.017495 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:00.017496 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:00.017496 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:00.017632 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:00.017906 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:00.017913 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:00.018089 (+ 176us) client_negotiation.cc:769] Sending connection context
0807 20:20:00.018205 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 20:20:00.018374 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":92,"threads_started":1}
I20260807 20:20:00.019044 20953 heartbeater.cc:347] Connected to a master server at 127.30.35.254:39129
I20260807 20:20:00.019137 20953 heartbeater.cc:464] Registering TS with master...
I20260807 20:20:00.019306 20953 heartbeater.cc:511] Master 127.30.35.254:39129 requested a full tablet report, sending...
I20260807 20:20:00.019634 20492 ts_manager.cc:194] Registered new tserver with Master: 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181)
I20260807 20:20:00.020004 20492 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:48965
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:20:00.035710 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:39129
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:20:00.117072 20959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:00.117287 20959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:00.117311 20959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:00.118465 20959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:00.118510 20959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:00.118536 20959 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:20:00.119953 20959 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:00.120175 20959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:00.120399 20959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:20:00.125311 20967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:00.125340 20964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:00.125501 20959 server_base.cc:1034] running on GCE node
W20260807 20:20:00.125340 20965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:00.125805 20959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:00.126030 20959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:00.127167 20959 hybrid_clock.cc:648] HybridClock initialized: now 1786134000127150 us; error 35 us; skew 500 ppm
Aug 07 20:20:00 dist-test-slave-t7g5 krb5kdc[20430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134000, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:00.133322 20959 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:20:00.133880 20959 webserver.cc:460] Webserver started at http://127.30.35.195:37967/ using document root <none> and password file <none>
I20260807 20:20:00.134124 20959 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:00.134169 20959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:00.134308 20959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:20:00.135391 20959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "000eeba808bc41f2ba0ffc36cbfc29d4"
format_stamp: "Formatted at 2026-08-07 20:20:00 on dist-test-slave-t7g5"
server_key: "51995b8b7c68e118469320ecdc0ab1dc"
server_key_iv: "6501374ae3ff2363596c211c2d584c9c"
server_key_version: "encryptionkey@0"
I20260807 20:20:00.135740 20959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "000eeba808bc41f2ba0ffc36cbfc29d4"
format_stamp: "Formatted at 2026-08-07 20:20:00 on dist-test-slave-t7g5"
server_key: "51995b8b7c68e118469320ecdc0ab1dc"
server_key_iv: "6501374ae3ff2363596c211c2d584c9c"
server_key_version: "encryptionkey@0"
I20260807 20:20:00.137157 20959 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 20:20:00.137933 20977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:00.138091 20959 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:20:00.138176 20959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "000eeba808bc41f2ba0ffc36cbfc29d4"
format_stamp: "Formatted at 2026-08-07 20:20:00 on dist-test-slave-t7g5"
server_key: "51995b8b7c68e118469320ecdc0ab1dc"
server_key_iv: "6501374ae3ff2363596c211c2d584c9c"
server_key_version: "encryptionkey@0"
I20260807 20:20:00.138247 20959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:00.153234 20959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:00.155007 20959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:00.155139 20959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:00.155372 20959 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:20:00.155695 20959 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:20:00.155730 20959 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:00.155751 20959 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:20:00.155776 20959 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:00.161362 20959 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:35549
I20260807 20:20:00.161402 21137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:35549 every 8 connection(s)
I20260807 20:20:00.161731 20959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
Aug 07 20:20:00 dist-test-slave-t7g5 krb5kdc[20430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134000, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:20:00.170938 20570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.162404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:47115 (local address 127.30.35.254:39129)
0807 20:20:00.162454 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:00.162456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:00.162635 (+ 179us) server_negotiation.cc:407] Connection header received
0807 20:20:00.163151 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:00.163153 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:00.163167 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:00.163219 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:00.164159 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.164680 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.165665 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.165865 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.165921 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.168061 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:00.168063 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:00.168063 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:00.168072 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:00.169479 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:00.170058 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:00.170059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:00.170060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:00.170113 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:00.170345 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:00.170346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:00.170347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:00.170456 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:00.170512 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:00.170769 (+ 257us) server_negotiation.cc:299] Negotiation successful
0807 20:20:00.170846 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 20:20:00.170970 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 20959
I20260807 20:20:00.171083 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:20:00.171137 21141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.162377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:47115)
0807 20:20:00.162522 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:00.162560 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:00.163054 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:00.163294 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:00.163298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:00.163863 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:00.164060 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.164065 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.164761 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.164763 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.165566 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.165568 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.165935 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.165936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.166062 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.166519 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:00.166527 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:00.167961 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:00.169557 (+ 1596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:00.169563 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:00.169566 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:00.169846 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:00.170176 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:00.170177 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:00.170178 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:00.170289 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:00.170512 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:00.170519 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:00.170650 (+ 131us) client_negotiation.cc:769] Sending connection context
0807 20:20:00.170739 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 20:20:00.170927 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":71,"threads_started":1}
I20260807 20:20:00.171298 30863 external_mini_cluster.cc:1428] Setting key 7bb371a15642cb326cb90ac6f6209bf6
I20260807 20:20:00.171710 21138 heartbeater.cc:347] Connected to a master server at 127.30.35.254:39129
I20260807 20:20:00.171804 21138 heartbeater.cc:464] Registering TS with master...
I20260807 20:20:00.171977 21138 heartbeater.cc:511] Master 127.30.35.254:39129 requested a full tablet report, sending...
I20260807 20:20:00.172308 20489 ts_manager.cc:194] Registered new tserver with Master: 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549)
I20260807 20:20:00.172634 20489 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:47115
I20260807 20:20:00.182896 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:20:00.190593 20570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.184135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56018 (local address 127.30.35.254:39129)
0807 20:20:00.184197 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:00.184199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:00.184276 (+ 77us) server_negotiation.cc:407] Connection header received
0807 20:20:00.184340 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:00.184341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:00.184350 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:00.184397 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:00.184904 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.185365 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.186109 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.186307 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.186360 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.187428 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:00.187430 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:00.187430 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:00.187444 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:00.188712 (+ 1268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:00.189166 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:00.189168 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:00.189168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:00.189252 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:00.189489 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:00.189490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:00.189490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:00.189702 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:00.189782 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:00.190023 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 20:20:00.190104 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 20:20:00.195776 20489 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56018:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:20:00.197885 20489 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:20:00.204939 21148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.200599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:41181 (local address 127.0.0.1:40724)
0807 20:20:00.200735 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:00.200790 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:00.200860 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:00.201287 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:00.201291 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:00.201294 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:00.201403 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.201406 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.202664 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.202665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.203904 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.203909 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.204642 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.204643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.204730 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.204747 (+ 17us) client_negotiation.cc:769] Sending connection context
0807 20:20:00.204806 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 20:20:00.204863 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":61,"threads_started":1}
I20260807 20:20:00.205147 21150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.200850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40724 (local address 127.30.35.194:41181)
0807 20:20:00.201115 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:00.201120 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:00.201130 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:20:00.201171 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:00.201173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:00.201188 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:00.201271 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:00.201515 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.202561 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.204010 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.204558 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.204900 (+ 342us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.204978 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:00.205007 (+ 29us) server_negotiation.cc:299] Negotiation successful
0807 20:20:00.205050 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":100,"threads_started":1}
I20260807 20:20:00.205536 21152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.201021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48598 (local address 127.30.35.193:38763)
0807 20:20:00.201454 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:00.201459 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:00.201618 (+ 159us) server_negotiation.cc:407] Connection header received
0807 20:20:00.201683 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:00.201686 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:00.201702 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:00.201771 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:00.201985 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.203077 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.204392 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.205105 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.205151 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.205203 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:00.205412 (+ 209us) server_negotiation.cc:299] Negotiation successful
0807 20:20:00.205453 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":92,"threads_started":1}
I20260807 20:20:00.205775 21151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.200906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:38763 (local address 127.0.0.1:48598)
0807 20:20:00.201504 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:00.201514 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:00.201566 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:00.201857 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:00.201858 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:00.201861 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:00.201913 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.201915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.203193 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.203194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.204294 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.204297 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.205268 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.205269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.205332 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.205336 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:20:00.205620 (+ 284us) client_negotiation.cc:240] Negotiation successful
0807 20:20:00.205706 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":60,"threads_started":1}
I20260807 20:20:00.206105 20855 tablet_service.cc:1467] Processing CreateTablet for tablet 1272c0ca644847c783741f21af1a0d25 (DEFAULT_TABLE table=test-table [id=c8c443ac67de4d54aefb6878b6695b74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:20:00.206470 20855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1272c0ca644847c783741f21af1a0d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:20:00.206985 21153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.201065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40534 (local address 127.30.35.195:35549)
0807 20:20:00.203243 (+ 2178us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:00.203248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:00.203258 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:20:00.203292 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:00.203294 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:00.203309 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:00.203380 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:00.203574 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.204596 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.205972 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.206672 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.206732 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.206767 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:00.206894 (+ 127us) server_negotiation.cc:299] Negotiation successful
0807 20:20:00.206922 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2136,"thread_start_us":95,"threads_started":1}
I20260807 20:20:00.207018 21149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.200601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:35549 (local address 127.0.0.1:40534)
0807 20:20:00.200968 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:00.200977 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:00.201013 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:00.203461 (+ 2448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:00.203461 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:00.203464 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:00.203498 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.203499 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.204698 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.204699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.205880 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.205884 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.206751 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.206752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.206813 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.206818 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:20:00.206884 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 20:20:00.206922 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":59,"threads_started":1}
I20260807 20:20:00.207808 21048 tablet_service.cc:1467] Processing CreateTablet for tablet 1272c0ca644847c783741f21af1a0d25 (DEFAULT_TABLE table=test-table [id=c8c443ac67de4d54aefb6878b6695b74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:20:00.208117 21048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1272c0ca644847c783741f21af1a0d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:20:00.209599 21154 tablet_bootstrap.cc:492] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088: Bootstrap starting.
I20260807 20:20:00.210346 21154 tablet_bootstrap.cc:654] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088: Neither blocks nor log segments found. Creating new log.
I20260807 20:20:00.210844 21155 tablet_bootstrap.cc:492] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4: Bootstrap starting.
I20260807 20:20:00.211061 21154 log.cc:824] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:00.211385 20661 tablet_service.cc:1467] Processing CreateTablet for tablet 1272c0ca644847c783741f21af1a0d25 (DEFAULT_TABLE table=test-table [id=c8c443ac67de4d54aefb6878b6695b74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:20:00.211530 21155 tablet_bootstrap.cc:654] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4: Neither blocks nor log segments found. Creating new log.
I20260807 20:20:00.211705 20661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1272c0ca644847c783741f21af1a0d25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:20:00.212008 21154 tablet_bootstrap.cc:492] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088: No bootstrap required, opened a new log
I20260807 20:20:00.212113 21154 ts_tablet_manager.cc:1397] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 20:20:00.212101 21155 log.cc:824] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:00.212935 21155 tablet_bootstrap.cc:492] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4: No bootstrap required, opened a new log
I20260807 20:20:00.213011 21155 ts_tablet_manager.cc:1397] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:20:00.214207 21154 raft_consensus.cc:348] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } }
I20260807 20:20:00.214389 21154 raft_consensus.cc:374] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:20:00.214437 21154 raft_consensus.cc:729] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cb8ce06a9494109af547519d87c4088, State: Initialized, Role: FOLLOWER
I20260807 20:20:00.214570 21154 consensus_queue.cc:260] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } }
I20260807 20:20:00.214843 21154 ts_tablet_manager.cc:1428] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:20:00.214985 20953 heartbeater.cc:503] Master 127.30.35.254:39129 was elected leader, sending a full tablet report...
I20260807 20:20:00.214900 21155 raft_consensus.cc:348] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } }
I20260807 20:20:00.215068 21155 raft_consensus.cc:374] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:20:00.215114 21155 raft_consensus.cc:729] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 000eeba808bc41f2ba0ffc36cbfc29d4, State: Initialized, Role: FOLLOWER
I20260807 20:20:00.215230 21155 consensus_queue.cc:260] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } }
I20260807 20:20:00.215890 21138 heartbeater.cc:503] Master 127.30.35.254:39129 was elected leader, sending a full tablet report...
I20260807 20:20:00.216159 21155 ts_tablet_manager.cc:1428] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:20:00.217347 21161 tablet_bootstrap.cc:492] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Bootstrap starting.
I20260807 20:20:00.218057 21161 tablet_bootstrap.cc:654] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Neither blocks nor log segments found. Creating new log.
I20260807 20:20:00.218639 21161 log.cc:824] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:00.221432 21161 tablet_bootstrap.cc:492] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: No bootstrap required, opened a new log
I20260807 20:20:00.221498 21161 ts_tablet_manager.cc:1397] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260807 20:20:00.223220 21161 raft_consensus.cc:348] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } }
I20260807 20:20:00.223392 21161 raft_consensus.cc:374] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:20:00.223448 21161 raft_consensus.cc:729] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d91932229d9420e8fe47f721d34e7f4, State: Initialized, Role: FOLLOWER
I20260807 20:20:00.223626 21161 consensus_queue.cc:260] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } }
I20260807 20:20:00.223908 21161 ts_tablet_manager.cc:1428] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 20:20:00.223973 20756 heartbeater.cc:503] Master 127.30.35.254:39129 was elected leader, sending a full tablet report...
W20260807 20:20:00.258730 20955 tablet.cc:2369] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:20:00.361617 20758 tablet.cc:2369] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:20:00.412299 21140 tablet.cc:2369] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:20:00.486833 21163 raft_consensus.cc:482] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:20:00.486966 21163 raft_consensus.cc:504] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } }
I20260807 20:20:00.487277 21163 leader_election.cc:288] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181), 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549)
I20260807 20:20:00.490049 21153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.487558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:39945 (local address 127.30.35.195:35549)
0807 20:20:00.487605 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:00.487607 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:00.487680 (+ 73us) server_negotiation.cc:407] Connection header received
0807 20:20:00.487738 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:00.487739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:00.487749 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:00.487798 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:00.487964 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.488422 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.489358 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.489745 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.489806 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.489815 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:00.489952 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 20:20:00.489985 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:20:00.490093 21150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.487532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:45287 (local address 127.30.35.194:41181)
0807 20:20:00.487611 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:00.487614 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:00.487683 (+ 69us) server_negotiation.cc:407] Connection header received
0807 20:20:00.487736 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:00.487737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:00.487746 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:00.487794 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:00.487980 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.488459 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.489363 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.489776 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.489840 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.489848 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:00.489991 (+ 143us) server_negotiation.cc:299] Negotiation successful
0807 20:20:00.490023 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 20:20:00.490116 21165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.487447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:41181 (local address 127.30.35.193:45287)
0807 20:20:00.487614 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:00.487624 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:00.487683 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:00.487808 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:00.487809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:00.487811 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:00.487907 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.487909 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.488530 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.488531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.489281 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.489283 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.489849 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.489850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.489924 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.489928 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:20:00.489975 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 20:20:00.490017 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":17,"thread_start_us":68,"threads_started":1}
I20260807 20:20:00.490250 21168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.487446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:35549 (local address 127.30.35.193:39945)
0807 20:20:00.487602 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:00.487615 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:00.487685 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:00.487811 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:00.487812 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:00.487814 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:00.487890 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.487892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.488495 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.488497 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.489269 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.489272 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.489819 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.489820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.489884 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.489888 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:20:00.489933 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:20:00.489974 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":2,"thread_start_us":67,"threads_started":1}
I20260807 20:20:00.490538 20882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1272c0ca644847c783741f21af1a0d25" candidate_uuid: "9d91932229d9420e8fe47f721d34e7f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cb8ce06a9494109af547519d87c4088" is_pre_election: true
I20260807 20:20:00.490617 21076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1272c0ca644847c783741f21af1a0d25" candidate_uuid: "9d91932229d9420e8fe47f721d34e7f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" is_pre_election: true
I20260807 20:20:00.490674 20882 raft_consensus.cc:2454] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d91932229d9420e8fe47f721d34e7f4 in term 0.
I20260807 20:20:00.490775 21076 raft_consensus.cc:2454] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d91932229d9420e8fe47f721d34e7f4 in term 0.
I20260807 20:20:00.490897 20599 leader_election.cc:302] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cb8ce06a9494109af547519d87c4088, 9d91932229d9420e8fe47f721d34e7f4; no voters:
I20260807 20:20:00.491029 21163 raft_consensus.cc:2781] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:20:00.491106 21163 raft_consensus.cc:482] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:20:00.491132 21163 raft_consensus.cc:3037] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:20:00.491852 21163 raft_consensus.cc:504] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } }
I20260807 20:20:00.491976 21163 leader_election.cc:288] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 1 election: Requested vote from peers 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181), 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549)
I20260807 20:20:00.492115 20882 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1272c0ca644847c783741f21af1a0d25" candidate_uuid: "9d91932229d9420e8fe47f721d34e7f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cb8ce06a9494109af547519d87c4088"
I20260807 20:20:00.492129 21076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1272c0ca644847c783741f21af1a0d25" candidate_uuid: "9d91932229d9420e8fe47f721d34e7f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4"
I20260807 20:20:00.492187 20882 raft_consensus.cc:3037] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:20:00.492200 21076 raft_consensus.cc:3037] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:20:00.492856 20882 raft_consensus.cc:2454] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d91932229d9420e8fe47f721d34e7f4 in term 1.
I20260807 20:20:00.492939 21076 raft_consensus.cc:2454] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d91932229d9420e8fe47f721d34e7f4 in term 1.
I20260807 20:20:00.493026 20599 leader_election.cc:302] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cb8ce06a9494109af547519d87c4088, 9d91932229d9420e8fe47f721d34e7f4; no voters:
I20260807 20:20:00.493125 21163 raft_consensus.cc:2781] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:20:00.493243 21163 raft_consensus.cc:686] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 LEADER]: Becoming Leader. State: Replica: 9d91932229d9420e8fe47f721d34e7f4, State: Running, Role: LEADER
I20260807 20:20:00.493324 21163 consensus_queue.cc:237] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } }
I20260807 20:20:00.494139 20489 catalog_manager.cc:5495] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9d91932229d9420e8fe47f721d34e7f4 (127.30.35.193). New cstate: current_term: 1 leader_uuid: "9d91932229d9420e8fe47f721d34e7f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } health_report { overall_health: UNKNOWN } } }
I20260807 20:20:00.559563 21152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.557289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48600 (local address 127.30.35.193:38763)
0807 20:20:00.557348 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:00.557350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:00.557357 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:20:00.557397 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:00.557398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:00.557418 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:00.557493 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:20:00.557620 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.558108 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.558837 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.559029 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.559087 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.559241 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:20:00.559351 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:20:00.559428 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:00.559460 (+ 32us) server_negotiation.cc:299] Negotiation successful
0807 20:20:00.559482 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 20:20:00.561406 20882 raft_consensus.cc:1261] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088 [term 1 FOLLOWER]: Refusing update from remote peer 9d91932229d9420e8fe47f721d34e7f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:20:00.561408 21076 raft_consensus.cc:1261] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 1 FOLLOWER]: Refusing update from remote peer 9d91932229d9420e8fe47f721d34e7f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:20:00.561851 21169 consensus_queue.cc:1035] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:20:00.562005 21163 consensus_queue.cc:1035] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:20:00.564597 21178 mvcc.cc:205] Tried to move back new op lower bound from 7316004866296774656 to 7316004866021265408. Current Snapshot: MvccSnapshot[applied={T|T < 7316004866296774656}]
I20260807 20:20:00.566675 20489 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:20:00.566772 20489 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:20:00.567483 20489 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Sending DeleteTablet for 3 replicas of tablet 1272c0ca644847c783741f21af1a0d25
I20260807 20:20:00.567844 20661 tablet_service.cc:1514] Processing DeleteTablet for tablet 1272c0ca644847c783741f21af1a0d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:20:00 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:48598
I20260807 20:20:00.567898 20855 tablet_service.cc:1514] Processing DeleteTablet for tablet 1272c0ca644847c783741f21af1a0d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:20:00 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:40724
I20260807 20:20:00.567902 21048 tablet_service.cc:1514] Processing DeleteTablet for tablet 1272c0ca644847c783741f21af1a0d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:20:00 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:40534
I20260807 20:20:00.568104 21187 tablet_replica.cc:330] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: stopping tablet replica
I20260807 20:20:00.568136 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 20575
I20260807 20:20:00.568197 21187 raft_consensus.cc:2229] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:20:00.568287 21187 raft_consensus.cc:2258] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:20:00.572664 21191 tablet_replica.cc:330] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088: stopping tablet replica
I20260807 20:20:00.572774 21191 raft_consensus.cc:2229] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:20:00.572885 21191 raft_consensus.cc:2258] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:20:00.573696 21191 ts_tablet_manager.cc:1905] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:20:00.575270 21191 ts_tablet_manager.cc:1918] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:20:00.575348 21191 log.cc:1196] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/1272c0ca644847c783741f21af1a0d25
I20260807 20:20:00.575567 21191 ts_tablet_manager.cc:1939] T 1272c0ca644847c783741f21af1a0d25 P 0cb8ce06a9494109af547519d87c4088: Deleting consensus metadata
I20260807 20:20:00.575969 20472 catalog_manager.cc:4841] TS 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181): tablet 1272c0ca644847c783741f21af1a0d25 (table test-table [id=c8c443ac67de4d54aefb6878b6695b74]) successfully deleted
I20260807 20:20:00.580461 21190 tablet_replica.cc:330] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4: stopping tablet replica
I20260807 20:20:00.580662 21190 raft_consensus.cc:2229] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:20:00.580848 21190 raft_consensus.cc:2258] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:20:00.583205 21190 ts_tablet_manager.cc:1905] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:20:00.584648 21190 ts_tablet_manager.cc:1918] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:20:00.584717 21190 log.cc:1196] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/1272c0ca644847c783741f21af1a0d25
I20260807 20:20:00.584919 21190 ts_tablet_manager.cc:1939] T 1272c0ca644847c783741f21af1a0d25 P 000eeba808bc41f2ba0ffc36cbfc29d4: Deleting consensus metadata
I20260807 20:20:00.585335 20470 catalog_manager.cc:4841] TS 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549): tablet 1272c0ca644847c783741f21af1a0d25 (table test-table [id=c8c443ac67de4d54aefb6878b6695b74]) successfully deleted
W20260807 20:20:00.587139 20473 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:38763 (error 108)
I20260807 20:20:00.587356 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 20764
I20260807 20:20:00.588902 21149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.587467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:38763 (local address 127.0.0.1:48612)
0807 20:20:00.588828 (+ 1361us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:00.588871 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:38763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1341}
W20260807 20:20:00.589052 20473 catalog_manager.cc:4584] TS 9d91932229d9420e8fe47f721d34e7f4 (127.30.35.193:38763): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1272c0ca644847c783741f21af1a0d25: Network error: Client connection negotiation failed: client connection to 127.30.35.193:38763: connect: Connection refused (error 111)
I20260807 20:20:00.594686 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 20959
I20260807 20:20:00.603893 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 20448
I20260807 20:20:00.617525 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:39129
--webserver_interface=127.30.35.254
--webserver_port=34989
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:39129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:20:00.698067 21196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:00.698273 21196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:00.698303 21196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:00.699409 21196 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:20:00.699456 21196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:00.699476 21196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:00.699491 21196 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:20:00.699508 21196 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:20:00.700947 21196 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:39129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:39129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=34989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:00.701184 21196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:00.701381 21196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 20:20:00.710361 21196 server_base.cc:1034] running on GCE node
W20260807 20:20:00.710338 21207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:00.710354 21209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:00.710331 21206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:00.710868 21196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:00.711180 21196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:00.712330 21196 hybrid_clock.cc:648] HybridClock initialized: now 1786134000712311 us; error 31 us; skew 500 ppm
Aug 07 20:20:00 dist-test-slave-t7g5 krb5kdc[20430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134000, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:00.714775 21196 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:20:00.715196 21196 webserver.cc:460] Webserver started at http://127.30.35.254:34989/ using document root <none> and password file <none>
I20260807 20:20:00.715411 21196 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:00.715489 21196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:00.716814 21196 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:20:00.717410 21222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:00.717573 21196 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:20:00.717677 21196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "c3ccce47d0394c0883adf6996bdc19b9"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "056e485b63899ea752f6e84af959b362"
server_key_iv: "0230cc6fab1030e583f2c5d9218c1cff"
server_key_version: "encryptionkey@0"
I20260807 20:20:00.718070 21196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:00.728439 21196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:00.730581 21196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:00.730718 21196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:00.734827 21196 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:39129
I20260807 20:20:00.734865 21296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:39129 every 8 connection(s)
I20260807 20:20:00.735258 21196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:20:00.736922 21297 sys_catalog.cc:263] Verifying existing consensus state
I20260807 20:20:00.737593 21297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Bootstrap starting.
I20260807 20:20:00.742499 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 21196
I20260807 20:20:00.742776 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:38763
--local_ip_for_outbound_sockets=127.30.35.193
--tserver_master_addrs=127.30.35.254:39129
--webserver_port=45307
--webserver_interface=127.30.35.193
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:20:00.746099 21297 log.cc:824] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:00.748194 21297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 20:20:00.748476 21297 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Bootstrap complete.
I20260807 20:20:00.750726 21297 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } }
I20260807 20:20:00.750973 21297 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3ccce47d0394c0883adf6996bdc19b9, State: Initialized, Role: FOLLOWER
I20260807 20:20:00.751140 21297 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } }
I20260807 20:20:00.751219 21297 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:20:00.751278 21297 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:20:00.751327 21297 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 20:20:00.752344 21297 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } }
I20260807 20:20:00.752446 21297 leader_election.cc:302] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3ccce47d0394c0883adf6996bdc19b9; no voters:
I20260807 20:20:00.752615 21297 leader_election.cc:288] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 20:20:00.752682 21301 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 20:20:00.752874 21297 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:20:00.752880 21301 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 2 LEADER]: Becoming Leader. State: Replica: c3ccce47d0394c0883adf6996bdc19b9, State: Running, Role: LEADER
I20260807 20:20:00.753022 21301 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } }
I20260807 20:20:00.753412 21303 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c3ccce47d0394c0883adf6996bdc19b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } } }
I20260807 20:20:00.753599 21303 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: This master's current role is: LEADER
I20260807 20:20:00.753418 21304 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3ccce47d0394c0883adf6996bdc19b9. Latest consensus state: current_term: 2 leader_uuid: "c3ccce47d0394c0883adf6996bdc19b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } } }
I20260807 20:20:00.753736 21304 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: This master's current role is: LEADER
I20260807 20:20:00.754689 21325 catalog_manager.cc:1259] Loaded cluster ID: 9efe31ee6cbf4b57b114623de6bc208a
I20260807 20:20:00.754735 21325 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: loading cluster ID for follower catalog manager: success
W20260807 20:20:00.754921 21325 catalog_manager.cc:1576] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260807 20:20:00.754969 21325 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260807 20:20:00.755000 21316 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:20:00.755347 21316 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:20:00.755420 21316 catalog_manager.cc:1259] Loaded cluster ID: 9efe31ee6cbf4b57b114623de6bc208a
I20260807 20:20:00.755448 21316 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:20:00.755606 21316 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 20:20:00.760582 21316 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 20:20:00.763060 21316 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:20:00.763252 21316 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Loaded TSK: 0
I20260807 20:20:00.763463 21316 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 20:20:00.828456 21299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:00.828655 21299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:00.828675 21299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:00.829820 21299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:00.829860 21299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:00.829885 21299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:20:00.831295 21299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:38763
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=45307
--tserver_master_addrs=127.30.35.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:00.831506 21299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:00.831722 21299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:20:00.836426 21336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:00.836496 21338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:00.836436 21335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:00.836793 21299 server_base.cc:1034] running on GCE node
I20260807 20:20:00.836977 21299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:00.837184 21299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:00.838327 21299 hybrid_clock.cc:648] HybridClock initialized: now 1786134000838309 us; error 31 us; skew 500 ppm
Aug 07 20:20:00 dist-test-slave-t7g5 krb5kdc[20430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134000, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:00.840787 21299 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:20:00.841228 21299 webserver.cc:460] Webserver started at http://127.30.35.193:45307/ using document root <none> and password file <none>
I20260807 20:20:00.841445 21299 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:00.841508 21299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:00.842834 21299 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:20:00.843477 21347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:00.843631 21299 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:20:00.843714 21299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "9d91932229d9420e8fe47f721d34e7f4"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "6c05bf9e24f43020755671ce51ce7e8f"
server_key_iv: "13bdfa7cc68bcf328e49807c2a4ab77a"
server_key_version: "encryptionkey@0"
I20260807 20:20:00.844038 21299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:00.863857 21299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:00.866047 21299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:00.866173 21299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:00.866415 21299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:20:00.866878 21359 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 20:20:00.868808 21299 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 20:20:00.868854 21299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 20:20:00.868888 21299 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 20:20:00.869534 21299 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 20:20:00.869568 21299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 20:20:00.869678 21359 tablet_bootstrap.cc:492] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Bootstrap starting.
I20260807 20:20:00.876261 21299 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:38763
I20260807 20:20:00.876403 21516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:38763 every 8 connection(s)
I20260807 20:20:00.876674 21299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:20:00.878895 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 21299
I20260807 20:20:00.879202 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:41181
--local_ip_for_outbound_sockets=127.30.35.194
--tserver_master_addrs=127.30.35.254:39129
--webserver_port=37027
--webserver_interface=127.30.35.194
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:20:00.880044 21359 log.cc:824] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:00.882390 21359 tablet_bootstrap.cc:492] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 20:20:00.882679 21359 tablet_bootstrap.cc:492] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Bootstrap complete.
I20260807 20:20:00.883740 21359 ts_tablet_manager.cc:1397] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Time spent bootstrapping tablet: real 0.014s user 0.013s sys 0.000s
Aug 07 20:20:00 dist-test-slave-t7g5 krb5kdc[20430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134000, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:20:00.884832 21359 raft_consensus.cc:348] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } }
I20260807 20:20:00.885138 21359 raft_consensus.cc:729] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d91932229d9420e8fe47f721d34e7f4, State: Initialized, Role: FOLLOWER
I20260807 20:20:00.885291 21359 consensus_queue.cc:260] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } }
I20260807 20:20:00.885582 21359 ts_tablet_manager.cc:1428] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:20:00.888623 21522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.877386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:33465)
0807 20:20:00.877592 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:00.877638 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:00.878146 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:00.878560 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:00.878564 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:00.878924 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:00.879197 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.879204 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.880676 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.880677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.881957 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.881961 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.882791 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.882792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.882941 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.883463 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:00.883473 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:00.885173 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:00.887117 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:00.887123 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:00.887125 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:00.887338 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:00.887615 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:00.887616 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:00.887616 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:00.887734 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:00.888163 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:00.888167 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:00.888276 (+ 109us) client_negotiation.cc:769] Sending connection context
0807 20:20:00.888354 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 20:20:00.888487 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":106,"threads_started":1}
I20260807 20:20:00.888777 21523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.877459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:33465 (local address 127.30.35.254:39129)
0807 20:20:00.877756 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:00.877764 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:00.877803 (+ 39us) server_negotiation.cc:407] Connection header received
0807 20:20:00.878350 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:00.878356 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:00.878398 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:00.878517 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:00.879345 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.880565 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.882049 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.882624 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.882725 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.885286 (+ 2561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:00.885291 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:00.885291 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:00.885303 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:00.887031 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:00.887422 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:00.887426 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:00.887426 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:00.887544 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:00.887797 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:00.887798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:00.887799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:00.888098 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:00.888189 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:00.888433 (+ 244us) server_negotiation.cc:299] Negotiation successful
0807 20:20:00.888573 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":76,"threads_started":1}
I20260807 20:20:00.889330 21518 heartbeater.cc:347] Connected to a master server at 127.30.35.254:39129
I20260807 20:20:00.889420 21518 heartbeater.cc:464] Registering TS with master...
I20260807 20:20:00.889581 21518 heartbeater.cc:511] Master 127.30.35.254:39129 requested a full tablet report, sending...
I20260807 20:20:00.890276 21243 ts_manager.cc:194] Registered new tserver with Master: 9d91932229d9420e8fe47f721d34e7f4 (127.30.35.193:38763)
I20260807 20:20:00.891300 21243 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:33465
I20260807 20:20:00.892304 21518 heartbeater.cc:503] Master 127.30.35.254:39129 was elected leader, sending a full tablet report...
Aug 07 20:20:00 dist-test-slave-t7g5 krb5kdc[20430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134000, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for kudu/127.30.35.193@KRBTEST.COM
I20260807 20:20:00.898232 21527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.890803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:38763 (local address 127.0.0.1:48618)
0807 20:20:00.891103 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:00.891132 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:00.891199 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:00.891460 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:00.891466 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:00.891782 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:00.891830 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.891833 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.892685 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.892686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.893297 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:00.893299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.893754 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.893755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:00.893837 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.894243 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:00.894248 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:00.895657 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:00.897162 (+ 1505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:00.897168 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:00.897170 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:00.897354 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:00.897546 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:00.897547 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:00.897547 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:00.897606 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:00.897874 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:00.897880 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:00.897930 (+ 50us) client_negotiation.cc:769] Sending connection context
0807 20:20:00.898013 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 20:20:00.898132 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":87,"threads_started":1}
I20260807 20:20:00.898239 21529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:00.890880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48618 (local address 127.30.35.193:38763)
0807 20:20:00.891048 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:00.891052 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:00.891201 (+ 149us) server_negotiation.cc:407] Connection header received
0807 20:20:00.891291 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:00.891293 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:00.891311 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:00.891380 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:00.891906 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.892611 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.893373 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:00.893691 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:00.893751 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:00.895734 (+ 1983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:00.895742 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:00.895742 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:00.895749 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:00.897081 (+ 1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:00.897426 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:00.897428 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:00.897429 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:00.897489 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:00.897674 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:00.897675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:00.897675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:00.897809 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:00.897884 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:00.898055 (+ 171us) server_negotiation.cc:299] Negotiation successful
0807 20:20:00.898139 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":136,"thread_start_us":90,"threads_started":1}
I20260807 20:20:00.898723 21420 tablet_service.cc:1514] Processing DeleteTablet for tablet 1272c0ca644847c783741f21af1a0d25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:20:00 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:48618
I20260807 20:20:00.899181 21530 tablet_replica.cc:330] stopping tablet replica
I20260807 20:20:00.899274 21530 raft_consensus.cc:2229] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:20:00.899339 21530 raft_consensus.cc:2258] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:20:00.899611 21530 ts_tablet_manager.cc:1905] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:20:00.901408 21530 ts_tablet_manager.cc:1918] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:20:00.901482 21530 log.cc:1196] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal/wals/1272c0ca644847c783741f21af1a0d25
I20260807 20:20:00.901705 21530 ts_tablet_manager.cc:1939] T 1272c0ca644847c783741f21af1a0d25 P 9d91932229d9420e8fe47f721d34e7f4: Deleting consensus metadata
I20260807 20:20:00.902165 21225 catalog_manager.cc:4841] TS 9d91932229d9420e8fe47f721d34e7f4 (127.30.35.193:38763): tablet 1272c0ca644847c783741f21af1a0d25 (table test-table [id=c8c443ac67de4d54aefb6878b6695b74]) successfully deleted
W20260807 20:20:00.967017 21525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:00.967212 21525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:00.967252 21525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:00.968343 21525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:00.968381 21525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:00.968415 21525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:20:00.969858 21525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:41181
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=37027
--tserver_master_addrs=127.30.35.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:00.970079 21525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:00.970286 21525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 20:20:00.975070 21525 server_base.cc:1034] running on GCE node
W20260807 20:20:00.975092 21545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:00.975054 21542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:00.975054 21541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:00.975431 21525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:00.975660 21525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:00.976792 21525 hybrid_clock.cc:648] HybridClock initialized: now 1786134000976779 us; error 30 us; skew 500 ppm
Aug 07 20:20:00 dist-test-slave-t7g5 krb5kdc[20430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134000, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:00.979389 21525 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:20:00.979790 21525 webserver.cc:460] Webserver started at http://127.30.35.194:37027/ using document root <none> and password file <none>
I20260807 20:20:00.979998 21525 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:00.980058 21525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:00.981382 21525 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:20:00.981954 21558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:00.982110 21525 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:00.982182 21525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "0cb8ce06a9494109af547519d87c4088"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "fc878d58a1d3f8dbf064591c71d08c87"
server_key_iv: "1d30b46c565d45b48f4fdb8135cb1dc0"
server_key_version: "encryptionkey@0"
I20260807 20:20:00.982517 21525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:00.998051 21525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:00.999694 21525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:00.999825 21525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:01.000033 21525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:20:01.000314 21525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:20:01.000349 21525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:01.000371 21525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:20:01.000393 21525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:01.006070 21525 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:41181
I20260807 20:20:01.006139 21738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:41181 every 8 connection(s)
I20260807 20:20:01.006445 21525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:20:01.009249 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 21525
I20260807 20:20:01.009541 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:35549
--local_ip_for_outbound_sockets=127.30.35.195
--tserver_master_addrs=127.30.35.254:39129
--webserver_port=37967
--webserver_interface=127.30.35.195
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 20:20:01 dist-test-slave-t7g5 krb5kdc[20430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134000, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:20:01.016369 21523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.007154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:40733 (local address 127.30.35.254:39129)
0807 20:20:01.007219 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:01.007221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:01.007408 (+ 187us) server_negotiation.cc:407] Connection header received
0807 20:20:01.007912 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:01.007914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:01.007931 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:01.007985 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:01.008941 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.009680 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.010675 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.010968 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.011043 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.013498 (+ 2455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:01.013500 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:01.013500 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:01.013509 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:01.015070 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:01.015458 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:01.015468 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:01.015468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:01.015532 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:01.015742 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:01.015743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:01.015744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:01.015881 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:01.015952 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:01.016178 (+ 226us) server_negotiation.cc:299] Negotiation successful
0807 20:20:01.016272 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 20:20:01.016445 21743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.007120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:40733)
0807 20:20:01.007289 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.007328 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:01.007811 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:01.008058 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:01.008063 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:01.008633 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:01.008832 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:01.008837 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.009779 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.009781 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:01.010587 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:01.010589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.011062 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.011063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:01.011216 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.011734 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:01.011745 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:01.013397 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:01.015149 (+ 1752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:01.015156 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:01.015158 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:01.015381 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:01.015597 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:01.015598 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:01.015598 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:01.015693 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:01.015938 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:01.015942 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:01.016064 (+ 122us) client_negotiation.cc:769] Sending connection context
0807 20:20:01.016141 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 20:20:01.016269 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":92,"threads_started":1}
I20260807 20:20:01.016918 21739 heartbeater.cc:347] Connected to a master server at 127.30.35.254:39129
I20260807 20:20:01.017027 21739 heartbeater.cc:464] Registering TS with master...
I20260807 20:20:01.017202 21739 heartbeater.cc:511] Master 127.30.35.254:39129 requested a full tablet report, sending...
I20260807 20:20:01.017632 21243 ts_manager.cc:194] Registered new tserver with Master: 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181)
I20260807 20:20:01.018146 21243 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:40733
W20260807 20:20:01.101011 21744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:01.101207 21744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:01.101228 21744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:01.102334 21744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:01.102372 21744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:01.102396 21744 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:20:01.103751 21744 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:35549
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=37967
--tserver_master_addrs=127.30.35.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:01.103940 21744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:01.104128 21744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:20:01.108785 21752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:01.108803 21753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:01.108843 21755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:01.109042 21744 server_base.cc:1034] running on GCE node
I20260807 20:20:01.109246 21744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:01.109475 21744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:01.110610 21744 hybrid_clock.cc:648] HybridClock initialized: now 1786134001110596 us; error 28 us; skew 500 ppm
Aug 07 20:20:01 dist-test-slave-t7g5 krb5kdc[20430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134001, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:01.113013 21744 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:20:01.113412 21744 webserver.cc:460] Webserver started at http://127.30.35.195:37967/ using document root <none> and password file <none>
I20260807 20:20:01.113611 21744 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:01.113692 21744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:01.114962 21744 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:20:01.115487 21767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:01.115628 21744 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:20:01.115712 21744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "000eeba808bc41f2ba0ffc36cbfc29d4"
format_stamp: "Formatted at 2026-08-07 20:20:00 on dist-test-slave-t7g5"
server_key: "51995b8b7c68e118469320ecdc0ab1dc"
server_key_iv: "6501374ae3ff2363596c211c2d584c9c"
server_key_version: "encryptionkey@0"
I20260807 20:20:01.116029 21744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:01.130425 21744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:01.132493 21744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:01.132623 21744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:01.132822 21744 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:20:01.133113 21744 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:20:01.133145 21744 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:01.133174 21744 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:20:01.133191 21744 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:01.138717 21744 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:35549
I20260807 20:20:01.138752 21926 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:35549 every 8 connection(s)
I20260807 20:20:01.139065 21744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
Aug 07 20:20:01 dist-test-slave-t7g5 krb5kdc[20430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134001, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:20:01.145809 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 21744
I20260807 20:20:01.147292 21523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.139723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:59219 (local address 127.30.35.254:39129)
0807 20:20:01.139788 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:01.139790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:01.139974 (+ 184us) server_negotiation.cc:407] Connection header received
0807 20:20:01.140412 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:01.140413 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:01.140422 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:01.140479 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:01.141317 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.141847 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.142764 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.142946 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.142999 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.144808 (+ 1809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:01.144809 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:01.144809 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:01.144816 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:01.145982 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:01.146417 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:01.146419 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:01.146419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:01.146489 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:01.146707 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:01.146708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:01.146708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:01.146846 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:01.146913 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:01.147154 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 20:20:01.147228 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 20:20:01.147505 21931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.139694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:59219)
0807 20:20:01.139846 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.139886 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:01.140335 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:01.140531 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:01.140534 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:01.141066 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:01.141246 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:01.141251 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.141921 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.141922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:01.142703 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:01.142706 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.143008 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.143009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:01.143102 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.143480 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:01.143488 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:01.144725 (+ 1237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:01.146049 (+ 1324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:01.146057 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:01.146060 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:01.146345 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:01.146549 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:01.146550 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:01.146550 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:01.146650 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:01.146903 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:01.146908 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:01.147023 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 20:20:01.147123 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 20:20:01.147277 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260807 20:20:01.147997 21928 heartbeater.cc:347] Connected to a master server at 127.30.35.254:39129
I20260807 20:20:01.148090 21928 heartbeater.cc:464] Registering TS with master...
I20260807 20:20:01.148255 21928 heartbeater.cc:511] Master 127.30.35.254:39129 requested a full tablet report, sending...
I20260807 20:20:01.148612 21243 ts_manager.cc:194] Registered new tserver with Master: 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549)
I20260807 20:20:01.148952 21243 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:59219
I20260807 20:20:01.152127 21934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.146149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56024 (local address 127.30.35.254:39129)
0807 20:20:01.146279 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:01.146281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:01.146315 (+ 34us) server_negotiation.cc:407] Connection header received
0807 20:20:01.146374 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:01.146375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:01.146387 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:01.146445 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:01.147081 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.147813 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.148745 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.148957 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.149007 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.150103 (+ 1096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:01.150104 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:01.150104 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:01.150111 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:01.151144 (+ 1033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:01.151443 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:01.151444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:01.151444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:01.151500 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:01.151661 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:01.151662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:01.151662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:01.151766 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:01.151919 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:01.151964 (+ 45us) server_negotiation.cc:299] Negotiation successful
0807 20:20:01.152038 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":49,"threads_started":1}
I20260807 20:20:01.152881 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:20:01.155401 21934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.153186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56030 (local address 127.30.35.254:39129)
0807 20:20:01.153242 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:01.153243 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:01.153306 (+ 63us) server_negotiation.cc:407] Connection header received
0807 20:20:01.153359 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:01.153360 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:01.153387 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:01.153440 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:20:01.153515 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.154131 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.154833 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.155026 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.155079 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.155178 (+ 99us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:20:01.155262 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:20:01.155314 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:01.155329 (+ 15us) server_negotiation.cc:299] Negotiation successful
0807 20:20:01.155345 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 20:20:01.155673 21243 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:56030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:20:01.157356 21243 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:20:01.159394 21420 tablet_service.cc:1467] Processing CreateTablet for tablet ca85f163cb2b4ad29bf93f50616f8f55 (DEFAULT_TABLE table=test-table [id=2eaf88789016411eacefde1b35d8d8d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:20:01.159574 21420 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca85f163cb2b4ad29bf93f50616f8f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:20:01.160827 21359 tablet_bootstrap.cc:492] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4: Bootstrap starting.
I20260807 20:20:01.161132 21359 tablet_bootstrap.cc:654] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4: Neither blocks nor log segments found. Creating new log.
I20260807 20:20:01.162814 21527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.159021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:41181 (local address 127.0.0.1:40738)
0807 20:20:01.159062 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.159072 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:01.159104 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:01.159445 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:01.159446 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:01.159448 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:01.159487 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:01.159489 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.160430 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.160431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:01.161404 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:01.161407 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.162555 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.162556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:01.162630 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.162650 (+ 20us) client_negotiation.cc:769] Sending connection context
0807 20:20:01.162700 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 20:20:01.162747 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260807 20:20:01.162847 21359 tablet_bootstrap.cc:492] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4: No bootstrap required, opened a new log
I20260807 20:20:01.162894 21359 ts_tablet_manager.cc:1397] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:20:01.162833 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.159117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40738 (local address 127.30.35.194:41181)
0807 20:20:01.159287 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:01.159292 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:01.159302 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:20:01.159341 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:01.159343 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:01.159359 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:01.159431 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:01.159548 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.160344 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.161511 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.162478 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.162536 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.162594 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:01.162722 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 20:20:01.162757 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":75,"threads_started":1}
I20260807 20:20:01.163033 21359 raft_consensus.cc:348] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:01.163107 21359 raft_consensus.cc:374] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:20:01.163156 21359 raft_consensus.cc:729] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d91932229d9420e8fe47f721d34e7f4, State: Initialized, Role: FOLLOWER
I20260807 20:20:01.163206 21359 consensus_queue.cc:260] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:01.163302 21359 ts_tablet_manager.cc:1428] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:01.164026 21636 tablet_service.cc:1467] Processing CreateTablet for tablet ca85f163cb2b4ad29bf93f50616f8f55 (DEFAULT_TABLE table=test-table [id=2eaf88789016411eacefde1b35d8d8d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:20:01.164388 21636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca85f163cb2b4ad29bf93f50616f8f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:20:01.164420 21938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.159073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:35549 (local address 127.0.0.1:40542)
0807 20:20:01.159229 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.159238 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:01.159278 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:01.161240 (+ 1962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:01.161241 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:01.161243 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:01.161281 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:01.161282 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.162451 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.162452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:01.163459 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:01.163462 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.164192 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.164192 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:01.164252 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.164256 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:20:01.164312 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 20:20:01.164350 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":106,"threads_started":1}
I20260807 20:20:01.164438 21941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.160847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40542 (local address 127.30.35.195:35549)
0807 20:20:01.161036 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:01.161041 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:01.161050 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:20:01.161087 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:01.161089 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:01.161101 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:01.161172 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:01.161341 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.162352 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.163544 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.164119 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.164183 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.164234 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:01.164332 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 20:20:01.164366 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":97,"threads_started":1}
I20260807 20:20:01.165057 21832 tablet_service.cc:1467] Processing CreateTablet for tablet ca85f163cb2b4ad29bf93f50616f8f55 (DEFAULT_TABLE table=test-table [id=2eaf88789016411eacefde1b35d8d8d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:20:01.165333 21832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca85f163cb2b4ad29bf93f50616f8f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:20:01.167196 21943 tablet_bootstrap.cc:492] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088: Bootstrap starting.
I20260807 20:20:01.167759 21943 tablet_bootstrap.cc:654] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088: Neither blocks nor log segments found. Creating new log.
I20260807 20:20:01.167909 21944 tablet_bootstrap.cc:492] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4: Bootstrap starting.
I20260807 20:20:01.168437 21943 log.cc:824] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:01.168576 21944 tablet_bootstrap.cc:654] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4: Neither blocks nor log segments found. Creating new log.
I20260807 20:20:01.169062 21944 log.cc:824] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:01.169168 21943 tablet_bootstrap.cc:492] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088: No bootstrap required, opened a new log
I20260807 20:20:01.169236 21943 ts_tablet_manager.cc:1397] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:20:01.169698 21944 tablet_bootstrap.cc:492] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4: No bootstrap required, opened a new log
I20260807 20:20:01.169757 21944 ts_tablet_manager.cc:1397] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:20:01.170626 21943 raft_consensus.cc:348] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:01.170755 21943 raft_consensus.cc:374] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:20:01.170800 21943 raft_consensus.cc:729] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cb8ce06a9494109af547519d87c4088, State: Initialized, Role: FOLLOWER
I20260807 20:20:01.170917 21943 consensus_queue.cc:260] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:01.171044 21944 raft_consensus.cc:348] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:01.171161 21943 ts_tablet_manager.cc:1428] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:20:01.171214 21739 heartbeater.cc:503] Master 127.30.35.254:39129 was elected leader, sending a full tablet report...
I20260807 20:20:01.171207 21944 raft_consensus.cc:374] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:20:01.171255 21944 raft_consensus.cc:729] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 000eeba808bc41f2ba0ffc36cbfc29d4, State: Initialized, Role: FOLLOWER
I20260807 20:20:01.171366 21944 consensus_queue.cc:260] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:01.171630 21944 ts_tablet_manager.cc:1428] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 20:20:01.171747 21928 heartbeater.cc:503] Master 127.30.35.254:39129 was elected leader, sending a full tablet report...
I20260807 20:20:01.200568 21949 raft_consensus.cc:482] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:20:01.200690 21949 raft_consensus.cc:504] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:01.201083 21949 leader_election.cc:288] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181), 9d91932229d9420e8fe47f721d34e7f4 (127.30.35.193:38763)
I20260807 20:20:01.204028 21529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.201399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:41827 (local address 127.30.35.193:38763)
0807 20:20:01.201444 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:01.201446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:01.201454 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:20:01.201530 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:01.201531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:01.201558 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:01.201613 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:01.201777 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.202291 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.203266 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.203687 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.203752 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.203834 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:01.203917 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 20:20:01.203958 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:20:01.204030 21940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.201352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:36657 (local address 127.30.35.194:41181)
0807 20:20:01.201401 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:01.201403 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:01.201548 (+ 145us) server_negotiation.cc:407] Connection header received
0807 20:20:01.201580 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:01.201581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:01.201590 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:01.201639 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:01.201841 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.202300 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.203347 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.203716 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.203778 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.203787 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:01.203925 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 20:20:01.203963 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 20:20:01.204033 21931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.201268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:38763 (local address 127.30.35.195:41827)
0807 20:20:01.201396 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.201408 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:01.201461 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:01.201623 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:01.201624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:01.201625 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:01.201717 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:01.201718 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.202381 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.202382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:01.203179 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:01.203181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.203765 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.203766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:01.203850 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.203854 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:20:01.203905 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 20:20:01.203948 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":35}
I20260807 20:20:01.204049 21950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.201268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:41181 (local address 127.30.35.195:36657)
0807 20:20:01.201470 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.201480 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:01.201536 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:01.201666 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:01.201667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:01.201668 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:01.201772 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:01.201774 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.202367 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.202368 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:01.203247 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:01.203250 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.203793 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.203794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:01.203865 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.203868 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:20:01.203913 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:20:01.203951 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":76,"thread_start_us":111,"threads_started":1}
I20260807 20:20:01.204330 21450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca85f163cb2b4ad29bf93f50616f8f55" candidate_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d91932229d9420e8fe47f721d34e7f4" is_pre_election: true
I20260807 20:20:01.204401 21666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca85f163cb2b4ad29bf93f50616f8f55" candidate_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cb8ce06a9494109af547519d87c4088" is_pre_election: true
I20260807 20:20:01.204491 21450 raft_consensus.cc:2454] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 000eeba808bc41f2ba0ffc36cbfc29d4 in term 0.
I20260807 20:20:01.204551 21666 raft_consensus.cc:2454] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 000eeba808bc41f2ba0ffc36cbfc29d4 in term 0.
I20260807 20:20:01.204723 21770 leader_election.cc:302] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 000eeba808bc41f2ba0ffc36cbfc29d4, 9d91932229d9420e8fe47f721d34e7f4; no voters:
I20260807 20:20:01.204856 21949 raft_consensus.cc:2781] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:20:01.204922 21949 raft_consensus.cc:482] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:20:01.204941 21949 raft_consensus.cc:3037] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:20:01.205622 21949 raft_consensus.cc:504] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:01.205904 21949 leader_election.cc:288] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [CANDIDATE]: Term 1 election: Requested vote from peers 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181), 9d91932229d9420e8fe47f721d34e7f4 (127.30.35.193:38763)
I20260807 20:20:01.205922 21450 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca85f163cb2b4ad29bf93f50616f8f55" candidate_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d91932229d9420e8fe47f721d34e7f4"
I20260807 20:20:01.205933 21666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca85f163cb2b4ad29bf93f50616f8f55" candidate_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cb8ce06a9494109af547519d87c4088"
I20260807 20:20:01.205999 21450 raft_consensus.cc:3037] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:20:01.205999 21666 raft_consensus.cc:3037] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:20:01.206837 21666 raft_consensus.cc:2454] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 000eeba808bc41f2ba0ffc36cbfc29d4 in term 1.
I20260807 20:20:01.206837 21450 raft_consensus.cc:2454] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 000eeba808bc41f2ba0ffc36cbfc29d4 in term 1.
I20260807 20:20:01.207041 21770 leader_election.cc:302] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 000eeba808bc41f2ba0ffc36cbfc29d4, 9d91932229d9420e8fe47f721d34e7f4; no voters:
I20260807 20:20:01.207159 21949 raft_consensus.cc:2781] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:20:01.207329 21949 raft_consensus.cc:686] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 1 LEADER]: Becoming Leader. State: Replica: 000eeba808bc41f2ba0ffc36cbfc29d4, State: Running, Role: LEADER
I20260807 20:20:01.207415 21949 consensus_queue.cc:237] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:01.208209 21242 catalog_manager.cc:5495] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195). New cstate: current_term: 1 leader_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260807 20:20:01.222939 21941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.220457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40556 (local address 127.30.35.195:35549)
0807 20:20:01.220500 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:01.220502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:01.220527 (+ 25us) server_negotiation.cc:407] Connection header received
0807 20:20:01.220651 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:01.220652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:01.220670 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:01.220732 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:20:01.220847 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.221434 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.222207 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:01.222412 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:01.222467 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:01.222613 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:20:01.222719 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:20:01.222789 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:01.222809 (+ 20us) server_negotiation.cc:299] Negotiation successful
0807 20:20:01.222839 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 20:20:01.224659 21666 raft_consensus.cc:1261] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088 [term 1 FOLLOWER]: Refusing update from remote peer 000eeba808bc41f2ba0ffc36cbfc29d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:20:01.224659 21450 raft_consensus.cc:1261] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Refusing update from remote peer 000eeba808bc41f2ba0ffc36cbfc29d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:20:01.225034 21951 consensus_queue.cc:1035] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:20:01.225180 21949 consensus_queue.cc:1035] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:20:01.227407 21955 mvcc.cc:205] Tried to move back new op lower bound from 7316004869013692416 to 7316004868946239488. Current Snapshot: MvccSnapshot[applied={T|T < 7316004869013692416}]
I20260807 20:20:01.227564 21956 mvcc.cc:205] Tried to move back new op lower bound from 7316004869013692416 to 7316004868946239488. Current Snapshot: MvccSnapshot[applied={T|T < 7316004869013692416}]
I20260807 20:20:01.227612 21957 mvcc.cc:205] Tried to move back new op lower bound from 7316004869013692416 to 7316004868946239488. Current Snapshot: MvccSnapshot[applied={T|T < 7316004869013692416}]
I20260807 20:20:01.229907 21243 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:56030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:20:01.229987 21243 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:56030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:20:01.230602 21243 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Sending DeleteTablet for 3 replicas of tablet ca85f163cb2b4ad29bf93f50616f8f55
I20260807 20:20:01.230893 21832 tablet_service.cc:1514] Processing DeleteTablet for tablet ca85f163cb2b4ad29bf93f50616f8f55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:20:01 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:40542
I20260807 20:20:01.230928 21420 tablet_service.cc:1514] Processing DeleteTablet for tablet ca85f163cb2b4ad29bf93f50616f8f55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:20:01 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:48618
I20260807 20:20:01.231014 21530 tablet_replica.cc:330] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4: stopping tablet replica
I20260807 20:20:01.231063 21530 raft_consensus.cc:2229] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:20:01.231123 21530 raft_consensus.cc:2258] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:20:01.231344 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 21299
I20260807 20:20:01.231432 21636 tablet_service.cc:1514] Processing DeleteTablet for tablet ca85f163cb2b4ad29bf93f50616f8f55 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:20:01 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:40738
I20260807 20:20:01.233788 21971 tablet_replica.cc:330] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4: stopping tablet replica
I20260807 20:20:01.233888 21971 raft_consensus.cc:2229] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:20:01.234006 21971 raft_consensus.cc:2258] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:20:01.236388 21971 ts_tablet_manager.cc:1905] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:20:01.238124 21971 ts_tablet_manager.cc:1918] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:20:01.238189 21971 log.cc:1196] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/ca85f163cb2b4ad29bf93f50616f8f55
I20260807 20:20:01.238483 21971 ts_tablet_manager.cc:1939] T ca85f163cb2b4ad29bf93f50616f8f55 P 000eeba808bc41f2ba0ffc36cbfc29d4: Deleting consensus metadata
I20260807 20:20:01.238934 21223 catalog_manager.cc:4841] TS 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549): tablet ca85f163cb2b4ad29bf93f50616f8f55 (table test-table [id=2eaf88789016411eacefde1b35d8d8d7]) successfully deleted
I20260807 20:20:01.247720 21972 tablet_replica.cc:330] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088: stopping tablet replica
I20260807 20:20:01.247862 21972 raft_consensus.cc:2229] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:20:01.247994 21972 raft_consensus.cc:2258] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:20:01.248540 21972 ts_tablet_manager.cc:1905] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:20:01.249950 21972 ts_tablet_manager.cc:1918] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:20:01.250021 21972 log.cc:1196] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/ca85f163cb2b4ad29bf93f50616f8f55
I20260807 20:20:01.250259 21972 ts_tablet_manager.cc:1939] T ca85f163cb2b4ad29bf93f50616f8f55 P 0cb8ce06a9494109af547519d87c4088: Deleting consensus metadata
I20260807 20:20:01.250691 21224 catalog_manager.cc:4841] TS 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181): tablet ca85f163cb2b4ad29bf93f50616f8f55 (table test-table [id=2eaf88789016411eacefde1b35d8d8d7]) successfully deleted
W20260807 20:20:01.252449 21225 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:38763 (error 108)
I20260807 20:20:01.252868 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 21525
I20260807 20:20:01.252941 21938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.252804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:38763 (local address 127.0.0.1:48632)
0807 20:20:01.252855 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.252891 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:38763: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 20:20:01.257460 21225 catalog_manager.cc:4584] TS 9d91932229d9420e8fe47f721d34e7f4 (127.30.35.193:38763): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ca85f163cb2b4ad29bf93f50616f8f55: Network error: Client connection negotiation failed: client connection to 127.30.35.193:38763: connect: Connection refused (error 111)
I20260807 20:20:01.273744 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 21744
I20260807 20:20:01.281555 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 21196
I20260807 20:20:01.288259 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:39129
--webserver_interface=127.30.35.254
--webserver_port=34989
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:39129
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:20:01.368947 21976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:01.369179 21976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:01.369207 21976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:01.370391 21976 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:20:01.370435 21976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:01.370455 21976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:01.370472 21976 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:20:01.370488 21976 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:20:01.371940 21976 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:39129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:39129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=34989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:01.372198 21976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:01.372408 21976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 20:20:01.377107 21976 server_base.cc:1034] running on GCE node
W20260807 20:20:01.377090 21984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:01.377079 21985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:01.377090 21987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:01.377538 21976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:01.377868 21976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:01.379017 21976 hybrid_clock.cc:648] HybridClock initialized: now 1786134001379003 us; error 31 us; skew 500 ppm
Aug 07 20:20:01 dist-test-slave-t7g5 krb5kdc[20430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134001, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:01.381338 21976 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:20:01.381821 21976 webserver.cc:460] Webserver started at http://127.30.35.254:34989/ using document root <none> and password file <none>
I20260807 20:20:01.382048 21976 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:01.382100 21976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:01.383433 21976 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:20:01.384066 21999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:01.384255 21976 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:20:01.384346 21976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "c3ccce47d0394c0883adf6996bdc19b9"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "056e485b63899ea752f6e84af959b362"
server_key_iv: "0230cc6fab1030e583f2c5d9218c1cff"
server_key_version: "encryptionkey@0"
I20260807 20:20:01.384718 21976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:01.401391 21976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:01.403261 21976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:01.403388 21976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:01.407217 21976 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:39129
I20260807 20:20:01.407253 22075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:39129 every 8 connection(s)
I20260807 20:20:01.407624 21976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:20:01.409139 22076 sys_catalog.cc:263] Verifying existing consensus state
I20260807 20:20:01.409798 22076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Bootstrap starting.
I20260807 20:20:01.413050 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 21976
I20260807 20:20:01.413311 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:38763
--local_ip_for_outbound_sockets=127.30.35.193
--tserver_master_addrs=127.30.35.254:39129
--webserver_port=45307
--webserver_interface=127.30.35.193
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:20:01.418399 22076 log.cc:824] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:01.420462 22076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 20:20:01.420730 22076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9: Bootstrap complete.
I20260807 20:20:01.422835 22076 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } }
I20260807 20:20:01.423055 22076 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3ccce47d0394c0883adf6996bdc19b9, State: Initialized, Role: FOLLOWER
I20260807 20:20:01.423197 22076 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } }
I20260807 20:20:01.423259 22076 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:20:01.423300 22076 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:20:01.423348 22076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 2 FOLLOWER]: Advancing to term 3
I20260807 20:20:01.424291 22076 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } }
I20260807 20:20:01.424387 22076 leader_election.cc:302] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3ccce47d0394c0883adf6996bdc19b9; no voters:
I20260807 20:20:01.424553 22076 leader_election.cc:288] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 20:20:01.424602 22082 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 20:20:01.424721 22082 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [term 3 LEADER]: Becoming Leader. State: Replica: c3ccce47d0394c0883adf6996bdc19b9, State: Running, Role: LEADER
I20260807 20:20:01.424817 22076 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:20:01.424819 22082 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } }
I20260807 20:20:01.425124 22082 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3ccce47d0394c0883adf6996bdc19b9. Latest consensus state: current_term: 3 leader_uuid: "c3ccce47d0394c0883adf6996bdc19b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } } }
I20260807 20:20:01.425192 22082 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: This master's current role is: LEADER
I20260807 20:20:01.425338 22086 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "c3ccce47d0394c0883adf6996bdc19b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ccce47d0394c0883adf6996bdc19b9" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39129 } } }
I20260807 20:20:01.425426 22086 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ccce47d0394c0883adf6996bdc19b9 [sys.catalog]: This master's current role is: LEADER
I20260807 20:20:01.425525 22089 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:20:01.426329 22089 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:20:01.426431 22089 catalog_manager.cc:1259] Loaded cluster ID: 9efe31ee6cbf4b57b114623de6bc208a
I20260807 20:20:01.426472 22089 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 20:20:01.426942 22089 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fafb953c9ad google::LogMessage::Fail() at ??:0
@ 0x7fafb953f88a google::LogMessage::SendToLog() at ??:0
@ 0x7fafb953c4de google::LogMessage::Flush() at ??:0
@ 0x7fafb953da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fafc14610f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fafc146a8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fafbb40a0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fafbb3ff954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fafbc2636db start_thread at ??:0
@ 0x7fafb803a61f clone at ??:0
W20260807 20:20:01.507673 22078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:01.507892 22078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:01.507925 22078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:01.509117 22078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:01.509158 22078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:01.509193 22078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:20:01.510670 22078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:38763
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=45307
--tserver_master_addrs=127.30.35.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:01.510908 22078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:01.511132 22078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:20:01.516019 22129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:01.516040 22127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:01.516062 22132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:01.516247 22078 server_base.cc:1034] running on GCE node
I20260807 20:20:01.516552 22078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:01.516795 22078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:01.517935 22078 hybrid_clock.cc:648] HybridClock initialized: now 1786134001517920 us; error 35 us; skew 500 ppm
Aug 07 20:20:01 dist-test-slave-t7g5 krb5kdc[20430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134001, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:01.520411 22078 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:20:01.520866 22078 webserver.cc:460] Webserver started at http://127.30.35.193:45307/ using document root <none> and password file <none>
I20260807 20:20:01.521073 22078 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:01.521123 22078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:01.522608 22078 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:20:01.523312 22142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:01.523471 22078 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:20:01.523557 22078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "9d91932229d9420e8fe47f721d34e7f4"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "6c05bf9e24f43020755671ce51ce7e8f"
server_key_iv: "13bdfa7cc68bcf328e49807c2a4ab77a"
server_key_version: "encryptionkey@0"
I20260807 20:20:01.523896 22078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:01.540500 22078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:01.542744 22078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:01.542891 22078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:01.543128 22078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:20:01.543591 22150 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 20:20:01.545557 22078 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 20:20:01.545599 22078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 20:20:01.545632 22078 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 20:20:01.546298 22078 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 20:20:01.546330 22078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 20:20:01.546430 22150 tablet_bootstrap.cc:492] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4: Bootstrap starting.
I20260807 20:20:01.553050 22078 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:38763
I20260807 20:20:01.553191 22300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:38763 every 8 connection(s)
I20260807 20:20:01.553467 22078 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:20:01.558139 22150 log.cc:824] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:01.559556 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 22078
I20260807 20:20:01.559844 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:41181
--local_ip_for_outbound_sockets=127.30.35.194
--tserver_master_addrs=127.30.35.254:39129
--webserver_port=37027
--webserver_interface=127.30.35.194
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:20:01.561010 22150 tablet_bootstrap.cc:492] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 20:20:01.561331 22150 tablet_bootstrap.cc:492] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4: Bootstrap complete.
I20260807 20:20:01.562520 22150 ts_tablet_manager.cc:1397] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.012s
I20260807 20:20:01.563941 22150 raft_consensus.cc:348] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:01.564280 22150 raft_consensus.cc:729] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d91932229d9420e8fe47f721d34e7f4, State: Initialized, Role: FOLLOWER
I20260807 20:20:01.564455 22150 consensus_queue.cc:260] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:01.564751 22150 ts_tablet_manager.cc:1428] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
W20260807 20:20:01.618317 22308 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:20:01.554175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:34441)
0807 20:20:01.554367 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.554404 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:01.554840 (+ 436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:01.618105 (+ 63265us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":112,"threads_started":1}
W20260807 20:20:01.618573 22303 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:39129 (0 consecutive failures): Network error: Failed to ping master at 127.30.35.254:39129: Client connection negotiation failed: client connection to 127.30.35.254:39129: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 20:20:01.618911 22308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.618805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:38875)
0807 20:20:01.618855 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.618893 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 20:20:01.619218 22308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.619140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:35447)
0807 20:20:01.619174 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.619196 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260807 20:20:01.619328 22303 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 20:20:01.644194 22310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:01.644397 22310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:01.644428 22310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:01.645586 22310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:01.645630 22310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:01.645684 22310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:20:01.647133 22310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:41181
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=37027
--tserver_master_addrs=127.30.35.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:01.647372 22310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:01.647579 22310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:20:01.652343 22316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:01.652338 22317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:01.652611 22310 server_base.cc:1034] running on GCE node
W20260807 20:20:01.652657 22320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:01.652904 22310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:01.653124 22310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:01.654289 22310 hybrid_clock.cc:648] HybridClock initialized: now 1786134001654268 us; error 37 us; skew 500 ppm
Aug 07 20:20:01 dist-test-slave-t7g5 krb5kdc[20430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134001, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:01.656806 22310 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:20:01.657215 22310 webserver.cc:460] Webserver started at http://127.30.35.194:37027/ using document root <none> and password file <none>
I20260807 20:20:01.657401 22310 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:01.657442 22310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:01.658682 22310 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:20:01.659247 22329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:01.659396 22310 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:20:01.659480 22310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "0cb8ce06a9494109af547519d87c4088"
format_stamp: "Formatted at 2026-08-07 20:19:59 on dist-test-slave-t7g5"
server_key: "fc878d58a1d3f8dbf064591c71d08c87"
server_key_iv: "1d30b46c565d45b48f4fdb8135cb1dc0"
server_key_version: "encryptionkey@0"
I20260807 20:20:01.659822 22310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:01.676208 22310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:01.678335 22310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:01.678471 22310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:01.678678 22310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:20:01.678972 22310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:20:01.679013 22310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:01.679040 22310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:20:01.679064 22310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:01.684696 22310 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:41181
I20260807 20:20:01.684758 22495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:41181 every 8 connection(s)
I20260807 20:20:01.685067 22310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:20:01.685447 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 22310
I20260807 20:20:01.685730 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:35549
--local_ip_for_outbound_sockets=127.30.35.195
--tserver_master_addrs=127.30.35.254:39129
--webserver_port=37967
--webserver_interface=127.30.35.195
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:20:01.686163 22499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.685776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:40297)
0807 20:20:01.685943 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.686026 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
W20260807 20:20:01.686529 22497 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:39129 (0 consecutive failures): Network error: Failed to ping master at 127.30.35.254:39129: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
I20260807 20:20:01.686815 22499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.686708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:56061)
0807 20:20:01.686755 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.686789 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 20:20:01.687103 22499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.687021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:56089)
0807 20:20:01.687058 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.687083 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260807 20:20:01.687211 22497 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 20:20:01.767560 22500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:01.767781 22500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:01.767813 22500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:01.768965 22500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:01.769009 22500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:01.769044 22500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:20:01.770515 22500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:35549
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=37967
--tserver_master_addrs=127.30.35.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:01.770754 22500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:01.770992 22500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:20:01.775878 22516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:01.775887 22513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:01.775923 22514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:01.775921 22500 server_base.cc:1034] running on GCE node
I20260807 20:20:01.776273 22500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:01.776479 22500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:01.777619 22500 hybrid_clock.cc:648] HybridClock initialized: now 1786134001777602 us; error 34 us; skew 500 ppm
Aug 07 20:20:01 dist-test-slave-t7g5 krb5kdc[20430](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134001, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:01.780102 22500 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:20:01.780522 22500 webserver.cc:460] Webserver started at http://127.30.35.195:37967/ using document root <none> and password file <none>
I20260807 20:20:01.780732 22500 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:01.780777 22500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:01.782119 22500 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:20:01.782682 22527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:01.782848 22500 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:20:01.782931 22500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "000eeba808bc41f2ba0ffc36cbfc29d4"
format_stamp: "Formatted at 2026-08-07 20:20:00 on dist-test-slave-t7g5"
server_key: "51995b8b7c68e118469320ecdc0ab1dc"
server_key_iv: "6501374ae3ff2363596c211c2d584c9c"
server_key_version: "encryptionkey@0"
I20260807 20:20:01.783294 22500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:01.798192 22500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:01.800196 22500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:01.800304 22500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:01.800544 22500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:20:01.800804 22500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:20:01.800834 22500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:01.800854 22500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:20:01.800879 22500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:01.806440 22500 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:35549
I20260807 20:20:01.806481 22683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:35549 every 8 connection(s)
I20260807 20:20:01.806811 22500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:20:01.807812 22686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.807440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:44689)
0807 20:20:01.807592 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.807667 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
W20260807 20:20:01.808182 22684 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:39129 (0 consecutive failures): Network error: Failed to ping master at 127.30.35.254:39129: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
I20260807 20:20:01.808423 22686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.808339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:42863)
0807 20:20:01.808380 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.808406 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260807 20:20:01.808619 22686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:01.808574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:34731)
0807 20:20:01.808592 (+ 18us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:01.808609 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10}
W20260807 20:20:01.808701 22684 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 20:20:01.811120 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 22500
I20260807 20:20:02.619863 22689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:02.619633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:60575)
0807 20:20:02.619761 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:02.619795 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":68,"threads_started":1}
I20260807 20:20:02.687652 22692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:02.687471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:44307)
0807 20:20:02.687570 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:02.687602 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":55,"threads_started":1}
I20260807 20:20:02.809190 22693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:02.808980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:39397)
0807 20:20:02.809105 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:02.809141 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":59,"threads_started":1}
I20260807 20:20:03.233040 22694 raft_consensus.cc:482] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:20:03.233170 22694 raft_consensus.cc:504] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:03.233475 22694 leader_election.cc:288] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181), 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549)
Aug 07 20:20:03 dist-test-slave-t7g5 krb5kdc[20430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134001, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.195@KRBTEST.COM
Aug 07 20:20:03 dist-test-slave-t7g5 krb5kdc[20430](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134001, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.194@KRBTEST.COM
I20260807 20:20:03.244140 22696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:03.233719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:35549 (local address 127.30.35.193:39545)
0807 20:20:03.233848 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:03.233860 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:03.233919 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:03.234954 (+ 1035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:03.234955 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:03.235208 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:03.235407 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:03.235413 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:03.236503 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:03.236504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:03.237329 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:03.237332 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:03.238171 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:03.238172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:03.238288 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:03.238879 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:03.238884 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:03.240540 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:03.242464 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:03.242470 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:03.242473 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:03.242754 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:03.243026 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:03.243027 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:03.243027 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:03.243171 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:03.243638 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:03.243644 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:03.243757 (+ 113us) client_negotiation.cc:769] Sending connection context
0807 20:20:03.243849 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 20:20:03.244022 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":44,"thread_start_us":56,"threads_started":1}
I20260807 20:20:03.244169 22699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:03.233854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:39545 (local address 127.30.35.195:35549)
0807 20:20:03.234010 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:03.234024 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:03.234057 (+ 33us) server_negotiation.cc:407] Connection header received
0807 20:20:03.234607 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:03.234610 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:03.234673 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:03.234823 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:03.235534 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:03.236406 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:03.237437 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:03.238105 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:03.238196 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:03.240650 (+ 2454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:03.240655 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:03.240655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:03.240669 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:03.242374 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:03.242834 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:03.242836 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:03.242836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:03.242945 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:03.243252 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:03.243253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:03.243254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:03.243573 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:03.243653 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:03.243916 (+ 263us) server_negotiation.cc:299] Negotiation successful
0807 20:20:03.244056 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":49,"threads_started":1}
I20260807 20:20:03.244226 22698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:03.233816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:60705 (local address 127.30.35.194:41181)
0807 20:20:03.234014 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:03.234024 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:03.234049 (+ 25us) server_negotiation.cc:407] Connection header received
0807 20:20:03.234607 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:03.234610 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:03.234672 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:03.234823 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:03.235534 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:03.236406 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:03.237408 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:03.238059 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:03.238192 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:03.241086 (+ 2894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:03.241091 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:03.241091 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:03.241105 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:03.242839 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:03.243201 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:03.243204 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:03.243205 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:03.243318 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:03.243506 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:03.243507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:03.243507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:03.243787 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:03.243854 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:03.244016 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 20:20:03.244135 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":57,"threads_started":1}
I20260807 20:20:03.244181 22697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:03.233704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:41181 (local address 127.30.35.193:60705)
0807 20:20:03.233827 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:03.233839 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:03.233899 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:03.234877 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:03.234880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:03.235208 (+ 328us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:03.235407 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:03.235413 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:03.236506 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:03.236507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:03.237333 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:03.237336 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:03.238153 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:03.238154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:03.238288 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:03.238846 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:03.238858 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:03.240980 (+ 2122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:03.242910 (+ 1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:03.242911 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:03.242912 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:03.243114 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:03.243388 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:03.243388 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:03.243389 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:03.243449 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:03.243851 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:03.243852 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:03.243888 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 20:20:03.243962 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 20:20:03.244072 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":83,"thread_start_us":58,"threads_started":1}
W20260807 20:20:03.245225 22143 leader_election.cc:341] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549): Not found: Tablet not found: ca85f163cb2b4ad29bf93f50616f8f55
W20260807 20:20:03.245307 22144 leader_election.cc:341] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181): Not found: Tablet not found: ca85f163cb2b4ad29bf93f50616f8f55
I20260807 20:20:03.245368 22144 leader_election.cc:302] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d91932229d9420e8fe47f721d34e7f4; no voters: 000eeba808bc41f2ba0ffc36cbfc29d4, 0cb8ce06a9494109af547519d87c4088
I20260807 20:20:03.245467 22694 raft_consensus.cc:2726] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 20:20:03.620483 22697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:03.620305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:53871)
0807 20:20:03.620385 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:03.620419 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 20:20:03.688185 22703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:03.687973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:46269)
0807 20:20:03.688095 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:03.688141 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":75,"threads_started":1}
I20260807 20:20:03.809788 22704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:03.809588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:57575)
0807 20:20:03.809717 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:03.809751 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":76,"threads_started":1}
I20260807 20:20:04.621145 22705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:04.620909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:41155)
0807 20:20:04.621051 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:04.621093 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":72,"threads_started":1}
I20260807 20:20:04.688723 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:04.688536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:52459)
0807 20:20:04.688646 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:04.688679 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":62,"threads_started":1}
I20260807 20:20:04.810348 22709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:04.810154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:43825)
0807 20:20:04.810268 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:04.810307 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":58,"threads_started":1}
I20260807 20:20:05.048560 22710 raft_consensus.cc:482] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:20:05.048672 22710 raft_consensus.cc:504] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:05.048851 22710 leader_election.cc:288] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181), 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549)
W20260807 20:20:05.049271 22143 leader_election.cc:341] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549): Not found: Tablet not found: ca85f163cb2b4ad29bf93f50616f8f55
W20260807 20:20:05.049399 22144 leader_election.cc:341] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181): Not found: Tablet not found: ca85f163cb2b4ad29bf93f50616f8f55
I20260807 20:20:05.049479 22144 leader_election.cc:302] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d91932229d9420e8fe47f721d34e7f4; no voters: 000eeba808bc41f2ba0ffc36cbfc29d4, 0cb8ce06a9494109af547519d87c4088
I20260807 20:20:05.049561 22710 raft_consensus.cc:2726] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 20:20:05.621801 22712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:05.621572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:34077)
0807 20:20:05.621714 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:05.621748 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":64,"threads_started":1}
I20260807 20:20:05.689318 22713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:05.689124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:54031)
0807 20:20:05.689245 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:05.689279 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":71,"threads_started":1}
I20260807 20:20:05.810927 22714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:05.810743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:47343)
0807 20:20:05.810852 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:05.810887 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":61,"threads_started":1}
I20260807 20:20:06.622479 22715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:06.622266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:35795)
0807 20:20:06.622391 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:06.622425 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
I20260807 20:20:06.689957 22716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:06.689736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:33917)
0807 20:20:06.689874 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:06.689912 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":76,"threads_started":1}
I20260807 20:20:06.811532 22717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:06.811317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:43861)
0807 20:20:06.811444 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:06.811487 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
I20260807 20:20:07.262450 22718 raft_consensus.cc:482] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:20:07.262558 22718 raft_consensus.cc:504] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:07.262734 22718 leader_election.cc:288] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181), 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549)
W20260807 20:20:07.263109 22143 leader_election.cc:341] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549): Not found: Tablet not found: ca85f163cb2b4ad29bf93f50616f8f55
W20260807 20:20:07.263214 22144 leader_election.cc:341] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181): Not found: Tablet not found: ca85f163cb2b4ad29bf93f50616f8f55
I20260807 20:20:07.263276 22144 leader_election.cc:302] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d91932229d9420e8fe47f721d34e7f4; no voters: 000eeba808bc41f2ba0ffc36cbfc29d4, 0cb8ce06a9494109af547519d87c4088
I20260807 20:20:07.263355 22718 raft_consensus.cc:2726] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 20:20:07.623162 22720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:07.622929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:35369)
0807 20:20:07.623072 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:07.623108 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":79,"threads_started":1}
I20260807 20:20:07.690549 22722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:07.690339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:53853)
0807 20:20:07.690463 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:07.690505 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
I20260807 20:20:07.812120 22723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:07.811912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:53839)
0807 20:20:07.812039 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:07.812076 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260807 20:20:08.623826 22724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:08.623594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:43717)
0807 20:20:08.623731 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:08.623773 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":72,"threads_started":1}
I20260807 20:20:08.691179 22725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:08.690949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:46141)
0807 20:20:08.691092 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:08.691132 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":80,"threads_started":1}
I20260807 20:20:08.812773 22726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:08.812547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:35471)
0807 20:20:08.812682 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:08.812727 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":64,"threads_started":1}
I20260807 20:20:09.624642 22727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:09.624380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:47773)
0807 20:20:09.624539 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:09.624586 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":75,"threads_started":1}
I20260807 20:20:09.691780 22728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:09.691573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:37023)
0807 20:20:09.691703 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:09.691737 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":63,"threads_started":1}
I20260807 20:20:09.813478 22729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:09.813247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:47573)
0807 20:20:09.813389 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:09.813430 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":64,"threads_started":1}
I20260807 20:20:10.625325 22730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:10.625120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:45239)
0807 20:20:10.625248 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:10.625274 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":63,"threads_started":1}
I20260807 20:20:10.692415 22733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:10.692188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:50223)
0807 20:20:10.692325 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:10.692370 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
I20260807 20:20:10.814127 22734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:10.813891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:51813)
0807 20:20:10.814033 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:10.814075 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":77,"threads_started":1}
I20260807 20:20:11.489951 22735 raft_consensus.cc:482] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:20:11.490063 22735 raft_consensus.cc:504] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:11.490236 22735 leader_election.cc:288] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181), 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549)
W20260807 20:20:11.490622 22144 leader_election.cc:341] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181): Not found: Tablet not found: ca85f163cb2b4ad29bf93f50616f8f55
W20260807 20:20:11.490721 22143 leader_election.cc:341] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549): Not found: Tablet not found: ca85f163cb2b4ad29bf93f50616f8f55
I20260807 20:20:11.490783 22143 leader_election.cc:302] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d91932229d9420e8fe47f721d34e7f4; no voters: 000eeba808bc41f2ba0ffc36cbfc29d4, 0cb8ce06a9494109af547519d87c4088
I20260807 20:20:11.490863 22735 raft_consensus.cc:2726] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 20:20:11.626133 22737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:11.625900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:45315)
0807 20:20:11.626042 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:11.626081 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":76,"threads_started":1}
I20260807 20:20:11.693032 22738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:11.692817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:58491)
0807 20:20:11.692950 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:11.692987 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260807 20:20:11.814716 22739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:11.814504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:40657)
0807 20:20:11.814633 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:11.814669 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":68,"threads_started":1}
I20260807 20:20:12.626732 22741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:12.626513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:52427)
0807 20:20:12.626646 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:12.626681 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":65,"threads_started":1}
I20260807 20:20:12.693717 22742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:12.693481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:55815)
0807 20:20:12.693609 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:12.693644 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":69,"threads_started":1}
I20260807 20:20:12.815384 22744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:12.815156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:43713)
0807 20:20:12.815300 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:12.815339 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":63,"threads_started":1}
I20260807 20:20:13.627297 22745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:13.627090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:48941)
0807 20:20:13.627215 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:13.627248 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":76,"threads_started":1}
I20260807 20:20:13.694355 22746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:13.694136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:40249)
0807 20:20:13.694261 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:13.694298 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":72,"threads_started":1}
I20260807 20:20:13.816044 22747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:13.815822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:52357)
0807 20:20:13.815959 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:13.815998 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":62,"threads_started":1}
I20260807 20:20:14.627945 22749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:14.627734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:41543)
0807 20:20:14.627854 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:14.627892 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":62,"threads_started":1}
I20260807 20:20:14.694931 22750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:14.694732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:52529)
0807 20:20:14.694842 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:14.694872 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":56,"threads_started":1}
I20260807 20:20:14.816708 22751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:14.816481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:53645)
0807 20:20:14.816602 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:14.816642 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":65,"threads_started":1}
I20260807 20:20:15.100142 22752 raft_consensus.cc:482] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:20:15.100248 22752 raft_consensus.cc:504] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cb8ce06a9494109af547519d87c4088" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 41181 } } peers { permanent_uuid: "000eeba808bc41f2ba0ffc36cbfc29d4" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35549 } } peers { permanent_uuid: "9d91932229d9420e8fe47f721d34e7f4" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38763 } }
I20260807 20:20:15.100423 22752 leader_election.cc:288] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181), 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549)
W20260807 20:20:15.100800 22143 leader_election.cc:341] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 000eeba808bc41f2ba0ffc36cbfc29d4 (127.30.35.195:35549): Not found: Tablet not found: ca85f163cb2b4ad29bf93f50616f8f55
W20260807 20:20:15.100901 22144 leader_election.cc:341] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0cb8ce06a9494109af547519d87c4088 (127.30.35.194:41181): Not found: Tablet not found: ca85f163cb2b4ad29bf93f50616f8f55
I20260807 20:20:15.100979 22144 leader_election.cc:302] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d91932229d9420e8fe47f721d34e7f4; no voters: 000eeba808bc41f2ba0ffc36cbfc29d4, 0cb8ce06a9494109af547519d87c4088
I20260807 20:20:15.101059 22752 raft_consensus.cc:2726] T ca85f163cb2b4ad29bf93f50616f8f55 P 9d91932229d9420e8fe47f721d34e7f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 20:20:15.628594 22753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:15.628367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:59585)
0807 20:20:15.628503 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:15.628542 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
I20260807 20:20:15.695502 22754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:15.695300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:56615)
0807 20:20:15.695411 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:15.695448 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":59,"threads_started":1}
I20260807 20:20:15.817348 22756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:15.817121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:57873)
0807 20:20:15.817250 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:15.817298 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
I20260807 20:20:16.629297 22757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:16.629075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.193:53733)
0807 20:20:16.629210 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:16.629246 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260807 20:20:16.696095 22758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:16.695898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.194:60423)
0807 20:20:16.696021 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:16.696054 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":67,"threads_started":1}
I20260807 20:20:16.817991 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 22078
I20260807 20:20:16.820473 22759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:16.817936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39129 (local address 127.30.35.195:56877)
0807 20:20:16.818107 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:16.820420 (+ 2313us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":65,"threads_started":1}
I20260807 20:20:16.830791 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 22310
I20260807 20:20:16.840560 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 22500
2026-08-07T20:20:16Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18557 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:20:16 dist-test-slave-t7g5 krb5kdc[22764](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:20:16 dist-test-slave-t7g5 krb5kdc[22764](info): set up 2 sockets
Aug 07 20:20:16 dist-test-slave-t7g5 krb5kdc[22764](info): commencing operation
krb5kdc: starting...
W20260807 20:20:17.981695 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:20:18 dist-test-slave-t7g5 krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:20:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:20:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:20:18.100224 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:41985
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:41985
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:20:18.180475 22788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:18.180699 22788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:18.180730 22788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:18.181897 22788 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 20:20:18.181939 22788 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 20:20:18.181957 22788 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 20:20:18.181972 22788 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:20:18.181988 22788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:18.182004 22788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:18.182026 22788 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:20:18.182046 22788 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:20:18.183555 22788 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:41985
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:41985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:18.183815 22788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:18.184034 22788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:20:18.188732 22799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:18.188732 22796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:18.188831 22795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:18.188898 22788 server_base.cc:1034] running on GCE node
I20260807 20:20:18.189417 22788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:18.189788 22788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:18.190945 22788 hybrid_clock.cc:648] HybridClock initialized: now 1786134018190921 us; error 42 us; skew 500 ppm
Aug 07 20:20:18 dist-test-slave-t7g5 krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134018, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:18.194089 22788 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:20:18.194561 22788 webserver.cc:460] Webserver started at http://127.30.35.254:42391/ using document root <none> and password file <none>
I20260807 20:20:18.194783 22788 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:18.194828 22788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:18.194948 22788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:20:18.196314 22788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "ca84d6566fd94c4591ddff0be7364238"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "785a34d8e88a5b2675d1c60f484a6db3"
server_key_iv: "38b0e594a1d0566ceb4d2e3d05b7435c"
server_key_version: "encryptionkey@0"
I20260807 20:20:18.196741 22788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "ca84d6566fd94c4591ddff0be7364238"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "785a34d8e88a5b2675d1c60f484a6db3"
server_key_iv: "38b0e594a1d0566ceb4d2e3d05b7435c"
server_key_version: "encryptionkey@0"
I20260807 20:20:18.198185 22788 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:20:18.198818 22813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:18.198952 22788 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:20:18.199043 22788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "ca84d6566fd94c4591ddff0be7364238"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "785a34d8e88a5b2675d1c60f484a6db3"
server_key_iv: "38b0e594a1d0566ceb4d2e3d05b7435c"
server_key_version: "encryptionkey@0"
I20260807 20:20:18.199115 22788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:18.224020 22788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:18.225801 22788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:18.225926 22788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:18.229633 22788 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:41985
I20260807 20:20:18.229701 22893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:41985 every 8 connection(s)
I20260807 20:20:18.230033 22788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:20:18.230854 22895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:20:18.233070 22895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Bootstrap starting.
I20260807 20:20:18.233690 22895 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Neither blocks nor log segments found. Creating new log.
I20260807 20:20:18.233982 22895 log.cc:824] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:18.234700 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 22788
I20260807 20:20:18.234759 22895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: No bootstrap required, opened a new log
I20260807 20:20:18.234804 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:20:18.235035 30863 external_mini_cluster.cc:1428] Setting key 52701ef2c2a0710c5ffbec2562604799
I20260807 20:20:18.236615 22895 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } }
I20260807 20:20:18.236757 22895 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:20:18.236791 22895 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca84d6566fd94c4591ddff0be7364238, State: Initialized, Role: FOLLOWER
I20260807 20:20:18.236917 22895 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } }
I20260807 20:20:18.236990 22895 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:20:18.237021 22895 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:20:18.237072 22895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:20:18.237926 22895 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } }
I20260807 20:20:18.238034 22895 leader_election.cc:302] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca84d6566fd94c4591ddff0be7364238; no voters:
I20260807 20:20:18.238178 22895 leader_election.cc:288] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:20:18.238225 22902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:20:18.238384 22902 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 1 LEADER]: Becoming Leader. State: Replica: ca84d6566fd94c4591ddff0be7364238, State: Running, Role: LEADER
I20260807 20:20:18.238430 22895 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:20:18.238479 22902 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } }
I20260807 20:20:18.238806 22905 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca84d6566fd94c4591ddff0be7364238. Latest consensus state: current_term: 1 leader_uuid: "ca84d6566fd94c4591ddff0be7364238" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } } }
I20260807 20:20:18.238889 22905 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: This master's current role is: LEADER
I20260807 20:20:18.239712 22916 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:20:18.239965 22903 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca84d6566fd94c4591ddff0be7364238" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } } }
I20260807 20:20:18.240029 22903 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: This master's current role is: LEADER
I20260807 20:20:18.240213 22916 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:20:18.241691 22916 catalog_manager.cc:1347] Generated new cluster ID: d300c016a7264423afebc2e55fe2be7e
I20260807 20:20:18.242168 22916 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:20:18 dist-test-slave-t7g5 krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:20:18.246111 22901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.235592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56216 (local address 127.30.35.254:41985)
0807 20:20:18.235780 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:18.235788 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:18.235814 (+ 26us) server_negotiation.cc:407] Connection header received
0807 20:20:18.236587 (+ 773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:18.236593 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:18.236640 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:18.236759 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:18.237500 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.238660 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.239730 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.240313 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.240429 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.243009 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:18.243013 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:18.243014 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:18.243025 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:18.244529 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:18.244852 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:18.244856 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:18.244856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:18.244956 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:18.245129 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:18.245130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:18.245130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:18.245381 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:18.245518 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:18.245628 (+ 110us) server_negotiation.cc:299] Negotiation successful
0807 20:20:18.245795 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":76,"threads_started":1}
I20260807 20:20:18.254845 22916 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:20:18.255563 22916 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:20:18.263604 22916 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Generated new TSK 0
I20260807 20:20:18.263793 22916 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:20:18.296487 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:41985
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:20:18.377481 22934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:18.377707 22934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:18.377741 22934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:18.378842 22934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:18.378883 22934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:18.378916 22934 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:20:18.380307 22934 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:41985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:18.380534 22934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:18.380733 22934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:20:18.385499 22942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:18.385506 22934 server_base.cc:1034] running on GCE node
W20260807 20:20:18.385576 22949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:18.385514 22943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:18.385926 22934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:18.386162 22934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:18.387308 22934 hybrid_clock.cc:648] HybridClock initialized: now 1786134018387294 us; error 29 us; skew 500 ppm
Aug 07 20:20:18 dist-test-slave-t7g5 krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134018, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:18.389793 22934 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:20:18.390204 22934 webserver.cc:460] Webserver started at http://127.30.35.193:37363/ using document root <none> and password file <none>
I20260807 20:20:18.390447 22934 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:18.390497 22934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:18.390626 22934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:20:18.391633 22934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "85a6ddd4190420b30b8d9f0f3e31c300"
server_key_iv: "2ae9021e7826d47349de7da25cc3dca1"
server_key_version: "encryptionkey@0"
I20260807 20:20:18.391968 22934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "85a6ddd4190420b30b8d9f0f3e31c300"
server_key_iv: "2ae9021e7826d47349de7da25cc3dca1"
server_key_version: "encryptionkey@0"
I20260807 20:20:18.393162 22934 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:20:18.393855 22962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:18.393994 22934 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:20:18.394078 22934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "85a6ddd4190420b30b8d9f0f3e31c300"
server_key_iv: "2ae9021e7826d47349de7da25cc3dca1"
server_key_version: "encryptionkey@0"
I20260807 20:20:18.394140 22934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:18.411531 22934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:18.413126 22934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:18.413254 22934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:18.413447 22934 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:20:18.413759 22934 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:20:18.413797 22934 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:18.413825 22934 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:20:18.413848 22934 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:18.419306 22934 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:38087
I20260807 20:20:18.419363 23126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:38087 every 8 connection(s)
I20260807 20:20:18.419637 22934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:20:18.421443 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 22934
I20260807 20:20:18.421546 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:20:18.421762 30863 external_mini_cluster.cc:1428] Setting key af8cf7fe332e0a9921a7b525141be92a
Aug 07 20:20:18 dist-test-slave-t7g5 krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134018, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:20:18.428719 22901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.420278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:46569 (local address 127.30.35.254:41985)
0807 20:20:18.420331 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:18.420334 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:18.420510 (+ 176us) server_negotiation.cc:407] Connection header received
0807 20:20:18.421007 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:18.421009 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:18.421026 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:18.421090 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:18.422187 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.422840 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.423804 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.424086 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.424151 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.426200 (+ 2049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:18.426202 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:18.426202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:18.426210 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:18.427499 (+ 1289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:18.427857 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:18.427858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:18.427858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:18.427918 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:18.428130 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:18.428131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:18.428131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:18.428241 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:18.428297 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:18.428547 (+ 250us) server_negotiation.cc:299] Negotiation successful
0807 20:20:18.428632 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:20:18.428879 23130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.420232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:46569)
0807 20:20:18.420399 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:18.420438 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:18.420886 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:18.421158 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:18.421161 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:18.421821 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:18.422100 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.422106 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.422925 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.422926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.423718 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.423720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.424173 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.424174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.424307 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.424768 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:18.424775 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:18.426113 (+ 1338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:18.427570 (+ 1457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:18.427577 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:18.427580 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:18.427791 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:18.427971 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:18.427971 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:18.427972 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:18.428076 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:18.428295 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:18.428302 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:18.428431 (+ 129us) client_negotiation.cc:769] Sending connection context
0807 20:20:18.428519 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 20:20:18.428666 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":82,"threads_started":1}
I20260807 20:20:18.429430 23128 heartbeater.cc:347] Connected to a master server at 127.30.35.254:41985
I20260807 20:20:18.429512 23128 heartbeater.cc:464] Registering TS with master...
I20260807 20:20:18.429708 23128 heartbeater.cc:511] Master 127.30.35.254:41985 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
I20260807 20:20:18.430245 22837 ts_manager.cc:194] Registered new tserver with Master: 9b5e4b7d4d96484a8bcef3f7afd1fb3b (127.30.35.193:38087)
I20260807 20:20:18.430810 22837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:46569
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:20:18.446205 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:41985
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:20:18.527817 23133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:18.528049 23133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:18.528082 23133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:18.529238 23133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:18.529280 23133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:18.529313 23133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:20:18.530828 23133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:41985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:18.531077 23133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:18.531296 23133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:20:18.536054 23142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:18.536055 23144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:18.536073 23140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:18.536286 23133 server_base.cc:1034] running on GCE node
I20260807 20:20:18.536487 23133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:18.536705 23133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:18.537837 23133 hybrid_clock.cc:648] HybridClock initialized: now 1786134018537829 us; error 29 us; skew 500 ppm
Aug 07 20:20:18 dist-test-slave-t7g5 krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134018, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:18.540462 23133 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:20:18.540853 23133 webserver.cc:460] Webserver started at http://127.30.35.194:34115/ using document root <none> and password file <none>
I20260807 20:20:18.541028 23133 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:18.541067 23133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:18.541158 23133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:20:18.542191 23133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "19caff2bac0a4095ad68bb052590d1e6"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "003aa343c43c3be332eac4c78727b38c"
server_key_iv: "c8380265c61281b36b2b738b7e9b234b"
server_key_version: "encryptionkey@0"
I20260807 20:20:18.542495 23133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "19caff2bac0a4095ad68bb052590d1e6"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "003aa343c43c3be332eac4c78727b38c"
server_key_iv: "c8380265c61281b36b2b738b7e9b234b"
server_key_version: "encryptionkey@0"
I20260807 20:20:18.543673 23133 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:20:18.544324 23155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:18.544507 23133 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:20:18.544601 23133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "19caff2bac0a4095ad68bb052590d1e6"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "003aa343c43c3be332eac4c78727b38c"
server_key_iv: "c8380265c61281b36b2b738b7e9b234b"
server_key_version: "encryptionkey@0"
I20260807 20:20:18.544664 23133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:18.555552 23133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:18.557332 23133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:18.557476 23133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:18.557709 23133 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:20:18.558022 23133 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:20:18.558055 23133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:18.558084 23133 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:20:18.558106 23133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:18.563591 23133 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:33425
I20260807 20:20:18.563651 23306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:33425 every 8 connection(s)
I20260807 20:20:18.563953 23133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
Aug 07 20:20:18 dist-test-slave-t7g5 krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134018, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:20:18.570791 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 23133
I20260807 20:20:18.570920 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:20:18.571118 30863 external_mini_cluster.cc:1428] Setting key 2a108969ee1611c918c0eeedad0d99a6
I20260807 20:20:18.572578 22901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.564582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:58347 (local address 127.30.35.254:41985)
0807 20:20:18.564634 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:18.564636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:18.564809 (+ 173us) server_negotiation.cc:407] Connection header received
0807 20:20:18.565310 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:18.565312 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:18.565333 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:18.565385 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:18.566353 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.566847 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.567795 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.567991 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.568050 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.570082 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:18.570084 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:18.570084 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:18.570092 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:18.571285 (+ 1193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:18.571698 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:18.571700 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:18.571700 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:18.571759 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:18.571980 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:18.571981 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:18.571982 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:18.572094 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:18.572151 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:18.572405 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 20:20:18.572493 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 20:20:18.572774 23309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.564548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:58347)
0807 20:20:18.564693 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:18.564730 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:18.565212 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:18.565457 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:18.565461 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:18.566062 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:18.566252 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.566257 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.566933 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.566934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.567708 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.567711 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.568061 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.568062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.568181 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.568594 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:18.568602 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:18.569955 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:18.571354 (+ 1399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:18.571361 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:18.571363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:18.571631 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:18.571808 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:18.571809 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:18.571810 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:18.571922 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:18.572148 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:18.572155 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:18.572286 (+ 131us) client_negotiation.cc:769] Sending connection context
0807 20:20:18.572377 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 20:20:18.572526 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":76,"threads_started":1}
I20260807 20:20:18.573191 23307 heartbeater.cc:347] Connected to a master server at 127.30.35.254:41985
I20260807 20:20:18.573292 23307 heartbeater.cc:464] Registering TS with master...
I20260807 20:20:18.573486 23307 heartbeater.cc:511] Master 127.30.35.254:41985 requested a full tablet report, sending...
I20260807 20:20:18.573900 22837 ts_manager.cc:194] Registered new tserver with Master: 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425)
I20260807 20:20:18.574260 22837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:58347
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:20:18.594475 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:41985
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:20:18.673934 23315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:18.674136 23315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:18.674165 23315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:18.675267 23315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:18.675307 23315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:18.675341 23315 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:20:18.676769 23315 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:41985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:18.677004 23315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:18.677205 23315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:20:18.681943 23323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:18.682149 23315 server_base.cc:1034] running on GCE node
W20260807 20:20:18.681974 23329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:18.681949 23322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:18.682454 23315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:18.682675 23315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:18.683813 23315 hybrid_clock.cc:648] HybridClock initialized: now 1786134018683799 us; error 29 us; skew 500 ppm
Aug 07 20:20:18 dist-test-slave-t7g5 krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134018, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:18.686266 23315 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:20:18.686664 23315 webserver.cc:460] Webserver started at http://127.30.35.195:34041/ using document root <none> and password file <none>
I20260807 20:20:18.686858 23315 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:18.686905 23315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:18.687037 23315 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:20:18.688045 23315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "06d1e7efbd6f403486c5290743f84ef9"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "c4dd12d9798491a6dbfc9bab1d17ff90"
server_key_iv: "cb50a745128944c07e28dc4f81968b13"
server_key_version: "encryptionkey@0"
I20260807 20:20:18.688405 23315 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "06d1e7efbd6f403486c5290743f84ef9"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "c4dd12d9798491a6dbfc9bab1d17ff90"
server_key_iv: "cb50a745128944c07e28dc4f81968b13"
server_key_version: "encryptionkey@0"
I20260807 20:20:18.689735 23315 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 20:20:18.690505 23339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:18.690659 23315 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:20:18.690745 23315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "06d1e7efbd6f403486c5290743f84ef9"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "c4dd12d9798491a6dbfc9bab1d17ff90"
server_key_iv: "cb50a745128944c07e28dc4f81968b13"
server_key_version: "encryptionkey@0"
I20260807 20:20:18.690815 23315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:18.705111 23315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:18.707315 23315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:18.707456 23315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:18.707669 23315 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:20:18.707968 23315 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:20:18.708004 23315 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:18.708033 23315 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:20:18.708055 23315 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:18.713372 23315 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:42143
I20260807 20:20:18.713435 23501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:42143 every 8 connection(s)
I20260807 20:20:18.713725 23315 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:20:18.718652 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 23315
I20260807 20:20:18.718771 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:20:18.718948 30863 external_mini_cluster.cc:1428] Setting key eef738f353aebb8cf1d6b181373dd5ba
Aug 07 20:20:18 dist-test-slave-t7g5 krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134018, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:20:18.722295 22901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.714382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:59281 (local address 127.30.35.254:41985)
0807 20:20:18.714424 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:18.714426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:18.714611 (+ 185us) server_negotiation.cc:407] Connection header received
0807 20:20:18.715088 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:18.715089 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:18.715098 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:18.715137 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:18.716020 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.716503 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.717386 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.717556 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.717599 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.719789 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:18.719790 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:18.719791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:18.719799 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:18.720903 (+ 1104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:18.721296 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:18.721297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:18.721297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:18.721361 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:18.721596 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:18.721597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:18.721598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:18.721759 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:18.721822 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:18.722098 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 20:20:18.722187 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 20:20:18.722443 23504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.714348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:59281)
0807 20:20:18.714497 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:18.714539 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:18.714993 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:18.715201 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:18.715205 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:18.715755 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:18.715955 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.715961 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.716561 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.716562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.717330 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.717332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.717608 (+ 276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.717608 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.717738 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.718155 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:18.718165 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:18.719674 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:18.720983 (+ 1309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:18.720990 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:18.720993 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:18.721219 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:18.721422 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:18.721423 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:18.721423 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:18.721534 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:18.721831 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:18.721838 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:18.721971 (+ 133us) client_negotiation.cc:769] Sending connection context
0807 20:20:18.722067 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 20:20:18.722226 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260807 20:20:18.722860 23502 heartbeater.cc:347] Connected to a master server at 127.30.35.254:41985
I20260807 20:20:18.722955 23502 heartbeater.cc:464] Registering TS with master...
I20260807 20:20:18.723131 23502 heartbeater.cc:511] Master 127.30.35.254:41985 requested a full tablet report, sending...
I20260807 20:20:18.723479 22837 ts_manager.cc:194] Registered new tserver with Master: 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143)
I20260807 20:20:18.723824 22837 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:59281
I20260807 20:20:18.730461 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:20:18.736912 22901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.731741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56220 (local address 127.30.35.254:41985)
0807 20:20:18.731794 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:18.731796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:18.731918 (+ 122us) server_negotiation.cc:407] Connection header received
0807 20:20:18.731957 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:18.731958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:18.731966 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:18.732011 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:18.732508 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.732984 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.733726 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.733908 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.733960 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.735017 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:18.735018 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:18.735018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:18.735025 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:18.736064 (+ 1039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:18.736346 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:18.736347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:18.736347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:18.736389 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:18.736518 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:18.736519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:18.736519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:18.736640 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:18.736708 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:18.736788 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 20:20:18.736842 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 20:20:18.738435 22837 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56220:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:20:18.740068 22837 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:20:18.745886 23518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.742188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:42143 (local address 127.0.0.1:47568)
0807 20:20:18.742501 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:18.742507 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:18.742538 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:18.742747 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:18.742748 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:18.742751 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:18.742800 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.742803 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.743652 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.743653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.744693 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.744696 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.745545 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.745546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.745628 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.745642 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 20:20:18.745750 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 20:20:18.745799 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"mutex_wait_us":1,"thread_start_us":41,"threads_started":1}
I20260807 20:20:18.745888 23517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.742284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47568 (local address 127.30.35.195:42143)
0807 20:20:18.742474 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:18.742480 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:18.742594 (+ 114us) server_negotiation.cc:407] Connection header received
0807 20:20:18.742641 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:18.742643 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:18.742658 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:18.742730 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:18.742862 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.743564 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.744778 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.745462 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.745534 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.745590 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:18.745768 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 20:20:18.745808 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":82,"threads_started":1}
I20260807 20:20:18.746116 23512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.742004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:38087 (local address 127.0.0.1:60328)
0807 20:20:18.742327 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:18.742369 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:18.742429 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:18.742729 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:18.742732 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:18.742734 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:18.742798 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.742800 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.743838 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.743839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.744947 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.744951 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.745890 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.745891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.745967 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.745972 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:20:18.746006 (+ 34us) client_negotiation.cc:240] Negotiation successful
0807 20:20:18.746051 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":49,"threads_started":1}
I20260807 20:20:18.746424 23514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.742140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60328 (local address 127.30.35.193:38087)
0807 20:20:18.742564 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:18.742568 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:18.742578 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:20:18.742617 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:18.742619 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:18.742634 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:18.742932 (+ 298us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:18.743010 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.743729 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.745036 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.745795 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.746200 (+ 405us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.746276 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:18.746300 (+ 24us) server_negotiation.cc:299] Negotiation successful
0807 20:20:18.746342 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":85,"threads_started":1}
I20260807 20:20:18.746958 23411 tablet_service.cc:1467] Processing CreateTablet for tablet a780c3d8e89e4477b5d30fdf287d093b (DEFAULT_TABLE table=test-table [id=3026378b06434777892cdead1e527776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:20:18.747357 23411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a780c3d8e89e4477b5d30fdf287d093b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:20:18.747406 23515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.742328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:33425 (local address 127.0.0.1:54754)
0807 20:20:18.743856 (+ 1528us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:18.743866 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:18.743921 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:18.744101 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:18.744102 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:18.744104 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:18.744159 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.744161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.745285 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.745285 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.746209 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.746213 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.747122 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.747123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.747184 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.747188 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:20:18.747297 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 20:20:18.747340 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1515,"mutex_wait_us":9,"thread_start_us":50,"threads_started":1}
I20260807 20:20:18.747417 23519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.742447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54754 (local address 127.30.35.194:33425)
0807 20:20:18.742639 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:18.742643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:18.743943 (+ 1300us) server_negotiation.cc:407] Connection header received
0807 20:20:18.743992 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:18.743994 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:18.744011 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:18.744098 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:18.744224 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.745204 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.746304 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.746966 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.747032 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.747084 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:18.747316 (+ 232us) server_negotiation.cc:299] Negotiation successful
0807 20:20:18.747353 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":81,"threads_started":1}
I20260807 20:20:18.748070 23221 tablet_service.cc:1467] Processing CreateTablet for tablet a780c3d8e89e4477b5d30fdf287d093b (DEFAULT_TABLE table=test-table [id=3026378b06434777892cdead1e527776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:20:18.748428 23221 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a780c3d8e89e4477b5d30fdf287d093b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:20:18.750092 23024 tablet_service.cc:1467] Processing CreateTablet for tablet a780c3d8e89e4477b5d30fdf287d093b (DEFAULT_TABLE table=test-table [id=3026378b06434777892cdead1e527776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:20:18.750365 23024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a780c3d8e89e4477b5d30fdf287d093b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:20:18.750690 23520 tablet_bootstrap.cc:492] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9: Bootstrap starting.
I20260807 20:20:18.751392 23520 tablet_bootstrap.cc:654] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9: Neither blocks nor log segments found. Creating new log.
I20260807 20:20:18.751492 23522 tablet_bootstrap.cc:492] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6: Bootstrap starting.
I20260807 20:20:18.752032 23522 tablet_bootstrap.cc:654] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6: Neither blocks nor log segments found. Creating new log.
I20260807 20:20:18.752105 23520 log.cc:824] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:18.752579 23522 log.cc:824] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:18.752935 23520 tablet_bootstrap.cc:492] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9: No bootstrap required, opened a new log
I20260807 20:20:18.753011 23520 ts_tablet_manager.cc:1397] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:20:18.753257 23522 tablet_bootstrap.cc:492] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6: No bootstrap required, opened a new log
I20260807 20:20:18.753324 23522 ts_tablet_manager.cc:1397] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:20:18.753814 23526 tablet_bootstrap.cc:492] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Bootstrap starting.
I20260807 20:20:18.754451 23526 tablet_bootstrap.cc:654] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Neither blocks nor log segments found. Creating new log.
I20260807 20:20:18.754712 23520 raft_consensus.cc:348] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } }
I20260807 20:20:18.754849 23520 raft_consensus.cc:374] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:20:18.754881 23520 raft_consensus.cc:729] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06d1e7efbd6f403486c5290743f84ef9, State: Initialized, Role: FOLLOWER
I20260807 20:20:18.755003 23526 log.cc:824] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:18.755012 23520 consensus_queue.cc:260] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } }
I20260807 20:20:18.755263 23520 ts_tablet_manager.cc:1428] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:20:18.755229 23522 raft_consensus.cc:348] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } }
I20260807 20:20:18.755401 23502 heartbeater.cc:503] Master 127.30.35.254:41985 was elected leader, sending a full tablet report...
I20260807 20:20:18.755410 23522 raft_consensus.cc:374] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:20:18.755443 23522 raft_consensus.cc:729] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19caff2bac0a4095ad68bb052590d1e6, State: Initialized, Role: FOLLOWER
I20260807 20:20:18.755565 23522 consensus_queue.cc:260] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } }
I20260807 20:20:18.755836 23522 ts_tablet_manager.cc:1428] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:20:18.755884 23307 heartbeater.cc:503] Master 127.30.35.254:41985 was elected leader, sending a full tablet report...
I20260807 20:20:18.756251 23526 tablet_bootstrap.cc:492] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: No bootstrap required, opened a new log
I20260807 20:20:18.756325 23526 ts_tablet_manager.cc:1397] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260807 20:20:18.757803 23526 raft_consensus.cc:348] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } }
I20260807 20:20:18.757943 23526 raft_consensus.cc:374] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:20:18.757987 23526 raft_consensus.cc:729] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b5e4b7d4d96484a8bcef3f7afd1fb3b, State: Initialized, Role: FOLLOWER
I20260807 20:20:18.758096 23526 consensus_queue.cc:260] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } }
I20260807 20:20:18.758324 23526 ts_tablet_manager.cc:1428] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:20:18.758360 23128 heartbeater.cc:503] Master 127.30.35.254:41985 was elected leader, sending a full tablet report...
W20260807 20:20:18.814481 23308 tablet.cc:2369] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:20:18.869714 23532 raft_consensus.cc:482] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:20:18.869882 23532 raft_consensus.cc:504] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } }
I20260807 20:20:18.870215 23532 leader_election.cc:288] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143), 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425)
I20260807 20:20:18.874073 23517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.870587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:50099 (local address 127.30.35.195:42143)
0807 20:20:18.870644 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:18.870646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:18.870655 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:20:18.870682 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:18.870683 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:18.870694 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:18.870744 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:18.870903 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.871656 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.873070 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.873679 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.873752 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.873761 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:18.873961 (+ 200us) server_negotiation.cc:299] Negotiation successful
0807 20:20:18.873999 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 20:20:18.874073 23519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.870655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:42371 (local address 127.30.35.194:33425)
0807 20:20:18.870717 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:18.870719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:18.870814 (+ 95us) server_negotiation.cc:407] Connection header received
0807 20:20:18.870859 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:18.870860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:18.870867 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:18.870921 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:18.871044 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.871714 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.873068 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.873680 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.873752 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.873761 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:18.873962 (+ 201us) server_negotiation.cc:299] Negotiation successful
0807 20:20:18.873999 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 20:20:18.874138 23130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.870425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:42143 (local address 127.30.35.193:50099)
0807 20:20:18.870505 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:18.870522 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:18.870590 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:18.870759 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:18.870760 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:18.870763 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:18.870839 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.870841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.871746 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.871747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.872987 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.872990 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.873768 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.873770 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.873877 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.873885 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 20:20:18.873951 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 20:20:18.874010 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":11}
I20260807 20:20:18.874145 23533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.870544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:33425 (local address 127.30.35.193:42371)
0807 20:20:18.870740 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:18.870751 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:18.870812 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:18.870937 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:18.870938 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:18.870939 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:18.870991 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.870993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.871799 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.871800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.873004 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:18.873006 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.873786 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.873787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:18.873877 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.873885 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 20:20:18.873951 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 20:20:18.874010 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":45,"thread_start_us":130,"threads_started":1}
I20260807 20:20:18.874522 23250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a780c3d8e89e4477b5d30fdf287d093b" candidate_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19caff2bac0a4095ad68bb052590d1e6" is_pre_election: true
I20260807 20:20:18.874542 23439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a780c3d8e89e4477b5d30fdf287d093b" candidate_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06d1e7efbd6f403486c5290743f84ef9" is_pre_election: true
I20260807 20:20:18.874662 23439 raft_consensus.cc:2454] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b5e4b7d4d96484a8bcef3f7afd1fb3b in term 0.
I20260807 20:20:18.874665 23250 raft_consensus.cc:2454] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9b5e4b7d4d96484a8bcef3f7afd1fb3b in term 0.
I20260807 20:20:18.874888 22969 leader_election.cc:302] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19caff2bac0a4095ad68bb052590d1e6, 9b5e4b7d4d96484a8bcef3f7afd1fb3b; no voters:
I20260807 20:20:18.875010 23532 raft_consensus.cc:2781] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:20:18.875068 23532 raft_consensus.cc:482] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:20:18.875097 23532 raft_consensus.cc:3037] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:20:18.875794 23532 raft_consensus.cc:504] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } }
I20260807 20:20:18.875917 23532 leader_election.cc:288] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 1 election: Requested vote from peers 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143), 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425)
I20260807 20:20:18.876089 23439 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a780c3d8e89e4477b5d30fdf287d093b" candidate_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06d1e7efbd6f403486c5290743f84ef9"
I20260807 20:20:18.876111 23250 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a780c3d8e89e4477b5d30fdf287d093b" candidate_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19caff2bac0a4095ad68bb052590d1e6"
I20260807 20:20:18.876158 23439 raft_consensus.cc:3037] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:20:18.876174 23250 raft_consensus.cc:3037] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:20:18.876799 23439 raft_consensus.cc:2454] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b5e4b7d4d96484a8bcef3f7afd1fb3b in term 1.
I20260807 20:20:18.876888 23250 raft_consensus.cc:2454] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9b5e4b7d4d96484a8bcef3f7afd1fb3b in term 1.
I20260807 20:20:18.876977 22969 leader_election.cc:302] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06d1e7efbd6f403486c5290743f84ef9, 9b5e4b7d4d96484a8bcef3f7afd1fb3b; no voters:
I20260807 20:20:18.877074 23532 raft_consensus.cc:2781] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:20:18.877234 23532 raft_consensus.cc:686] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 LEADER]: Becoming Leader. State: Replica: 9b5e4b7d4d96484a8bcef3f7afd1fb3b, State: Running, Role: LEADER
I20260807 20:20:18.877326 23532 consensus_queue.cc:237] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } }
I20260807 20:20:18.878196 22837 catalog_manager.cc:5495] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 9b5e4b7d4d96484a8bcef3f7afd1fb3b (127.30.35.193). New cstate: current_term: 1 leader_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } health_report { overall_health: UNKNOWN } } }
I20260807 20:20:18.888327 23514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.886384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60334 (local address 127.30.35.193:38087)
0807 20:20:18.886454 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:18.886456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:18.886464 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:20:18.886490 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:18.886490 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:18.886505 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:18.886561 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:20:18.886655 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.887085 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.887762 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:18.887934 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:18.887976 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:18.888087 (+ 111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:20:18.888181 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:20:18.888236 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:18.888249 (+ 13us) server_negotiation.cc:299] Negotiation successful
0807 20:20:18.888265 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260807 20:20:18.889971 23250 raft_consensus.cc:1261] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6 [term 1 FOLLOWER]: Refusing update from remote peer 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:20:18.889969 23439 raft_consensus.cc:1261] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9 [term 1 FOLLOWER]: Refusing update from remote peer 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:20:18.890321 23534 consensus_queue.cc:1035] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:20:18.890451 23532 consensus_queue.cc:1035] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:20:18.893158 23541 mvcc.cc:205] Tried to move back new op lower bound from 7316004941370822656 to 7316004941322215424. Current Snapshot: MvccSnapshot[applied={T|T < 7316004941370822656}]
I20260807 20:20:18.893404 23539 mvcc.cc:205] Tried to move back new op lower bound from 7316004941370822656 to 7316004941322215424. Current Snapshot: MvccSnapshot[applied={T|T < 7316004941370822656}]
I20260807 20:20:18.894728 22834 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:20:18.894814 22834 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56220:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:20:18.895520 22834 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Sending DeleteTablet for 3 replicas of tablet a780c3d8e89e4477b5d30fdf287d093b
I20260807 20:20:18.895852 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 22934
I20260807 20:20:18.895843 23024 tablet_service.cc:1514] Processing DeleteTablet for tablet a780c3d8e89e4477b5d30fdf287d093b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:20:18 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:60328
I20260807 20:20:18.895875 23221 tablet_service.cc:1514] Processing DeleteTablet for tablet a780c3d8e89e4477b5d30fdf287d093b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:20:18 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:54754
I20260807 20:20:18.903046 23411 tablet_service.cc:1514] Processing DeleteTablet for tablet a780c3d8e89e4477b5d30fdf287d093b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:20:18 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:47568
I20260807 20:20:18.903102 23555 tablet_replica.cc:330] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6: stopping tablet replica
I20260807 20:20:18.903210 23555 raft_consensus.cc:2229] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:20:18.903308 23555 raft_consensus.cc:2258] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:20:18.904001 23556 tablet_replica.cc:330] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9: stopping tablet replica
I20260807 20:20:18.904129 23556 raft_consensus.cc:2229] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:20:18.904263 23556 raft_consensus.cc:2258] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:20:18.905140 23555 ts_tablet_manager.cc:1905] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:20:18.905195 23556 ts_tablet_manager.cc:1905] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:20:18.906981 23555 ts_tablet_manager.cc:1918] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:20:18.906999 23556 ts_tablet_manager.cc:1918] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:20:18.907054 23555 log.cc:1196] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/a780c3d8e89e4477b5d30fdf287d093b
I20260807 20:20:18.907061 23556 log.cc:1196] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/a780c3d8e89e4477b5d30fdf287d093b
I20260807 20:20:18.907296 23555 ts_tablet_manager.cc:1939] T a780c3d8e89e4477b5d30fdf287d093b P 19caff2bac0a4095ad68bb052590d1e6: Deleting consensus metadata
I20260807 20:20:18.907348 23556 ts_tablet_manager.cc:1939] T a780c3d8e89e4477b5d30fdf287d093b P 06d1e7efbd6f403486c5290743f84ef9: Deleting consensus metadata
I20260807 20:20:18.907698 22819 catalog_manager.cc:4841] TS 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425): tablet a780c3d8e89e4477b5d30fdf287d093b (table test-table [id=3026378b06434777892cdead1e527776]) successfully deleted
I20260807 20:20:18.907892 22819 catalog_manager.cc:4841] TS 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143): tablet a780c3d8e89e4477b5d30fdf287d093b (table test-table [id=3026378b06434777892cdead1e527776]) successfully deleted
W20260807 20:20:18.909433 22819 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:38087 (error 108)
I20260807 20:20:18.909689 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 23133
I20260807 20:20:18.909869 23515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:18.909744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:38087 (local address 127.0.0.1:60340)
0807 20:20:18.909796 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:18.909828 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 20:20:18.914305 22819 catalog_manager.cc:4584] TS 9b5e4b7d4d96484a8bcef3f7afd1fb3b (127.30.35.193:38087): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a780c3d8e89e4477b5d30fdf287d093b: Network error: Client connection negotiation failed: client connection to 127.30.35.193:38087: connect: Connection refused (error 111)
I20260807 20:20:18.918377 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 23315
I20260807 20:20:18.927268 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 22788
I20260807 20:20:38.941969 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:41985
--webserver_interface=127.30.35.254
--webserver_port=42391
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:41985
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:20:39.022822 23558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:39.023028 23558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:39.023057 23558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:39.024190 23558 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 20:20:39.024235 23558 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 20:20:39.024251 23558 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 20:20:39.024266 23558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:20:39.024281 23558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:39.024298 23558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:39.024318 23558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:20:39.024343 23558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:20:39.025864 23558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:41985
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:41985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=42391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:39.026129 23558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:39.026335 23558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:20:39.035565 23566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:39.035630 23565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:39.035615 23569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:39.035636 23558 server_base.cc:1034] running on GCE node
I20260807 20:20:39.036026 23558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:39.036319 23558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:39.037480 23558 hybrid_clock.cc:648] HybridClock initialized: now 1786134039037462 us; error 32 us; skew 500 ppm
Aug 07 20:20:39 dist-test-slave-t7g5 krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134039, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:39.055476 23558 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:20:39.056023 23558 webserver.cc:460] Webserver started at http://127.30.35.254:42391/ using document root <none> and password file <none>
I20260807 20:20:39.056270 23558 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:39.056339 23558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:39.057761 23558 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:20:39.058386 23579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:39.058597 23558 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:39.058702 23558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "ca84d6566fd94c4591ddff0be7364238"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "785a34d8e88a5b2675d1c60f484a6db3"
server_key_iv: "38b0e594a1d0566ceb4d2e3d05b7435c"
server_key_version: "encryptionkey@0"
I20260807 20:20:39.059144 23558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:39.068195 23558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:39.069959 23558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:39.070091 23558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:39.074275 23558 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:41985
I20260807 20:20:39.074316 23647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:41985 every 8 connection(s)
I20260807 20:20:39.074689 23558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:20:39.076159 23649 sys_catalog.cc:263] Verifying existing consensus state
I20260807 20:20:39.076777 23649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Bootstrap starting.
I20260807 20:20:39.077637 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 23558
I20260807 20:20:39.077978 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:38087
--local_ip_for_outbound_sockets=127.30.35.193
--tserver_master_addrs=127.30.35.254:41985
--webserver_port=37363
--webserver_interface=127.30.35.193
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:20:39.085582 23649 log.cc:824] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:39.087461 23649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 20:20:39.087750 23649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Bootstrap complete.
I20260807 20:20:39.089951 23649 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } }
I20260807 20:20:39.090185 23649 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca84d6566fd94c4591ddff0be7364238, State: Initialized, Role: FOLLOWER
I20260807 20:20:39.090334 23649 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } }
I20260807 20:20:39.090389 23649 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:20:39.090444 23649 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:20:39.090492 23649 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 1 FOLLOWER]: Advancing to term 2
I20260807 20:20:39.091531 23649 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } }
I20260807 20:20:39.091629 23649 leader_election.cc:302] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca84d6566fd94c4591ddff0be7364238; no voters:
I20260807 20:20:39.091792 23649 leader_election.cc:288] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 20:20:39.091840 23655 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 20:20:39.092018 23655 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 2 LEADER]: Becoming Leader. State: Replica: ca84d6566fd94c4591ddff0be7364238, State: Running, Role: LEADER
I20260807 20:20:39.092077 23649 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:20:39.092141 23655 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } }
I20260807 20:20:39.092586 23655 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca84d6566fd94c4591ddff0be7364238. Latest consensus state: current_term: 2 leader_uuid: "ca84d6566fd94c4591ddff0be7364238" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } } }
I20260807 20:20:39.092681 23655 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: This master's current role is: LEADER
I20260807 20:20:39.092864 23656 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ca84d6566fd94c4591ddff0be7364238" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } } }
I20260807 20:20:39.093003 23656 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: This master's current role is: LEADER
I20260807 20:20:39.093152 23669 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:20:39.094038 23669 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:20:39.094200 23669 catalog_manager.cc:1259] Loaded cluster ID: d300c016a7264423afebc2e55fe2be7e
I20260807 20:20:39.094424 23669 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:20:39.095753 23669 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:20:39.095963 23669 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Loaded TSK: 0
I20260807 20:20:39.111922 23669 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Generated new TSK 1
I20260807 20:20:39.112053 23669 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 20:20:39.166457 23653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:39.166656 23653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:39.166677 23653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:39.167801 23653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:39.167843 23653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:39.167871 23653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:20:39.169305 23653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:38087
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=37363
--tserver_master_addrs=127.30.35.254:41985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:39.169566 23653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:39.169809 23653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:20:39.174757 23699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:39.174721 23692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:39.174706 23694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:39.175233 23653 server_base.cc:1034] running on GCE node
I20260807 20:20:39.175441 23653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:39.175691 23653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:39.176877 23653 hybrid_clock.cc:648] HybridClock initialized: now 1786134039176862 us; error 30 us; skew 500 ppm
Aug 07 20:20:39 dist-test-slave-t7g5 krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134039, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:39.179400 23653 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:20:39.179832 23653 webserver.cc:460] Webserver started at http://127.30.35.193:37363/ using document root <none> and password file <none>
I20260807 20:20:39.180063 23653 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:39.180125 23653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:39.181404 23653 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:20:39.182067 23707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:39.182221 23653 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:39.182292 23653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "85a6ddd4190420b30b8d9f0f3e31c300"
server_key_iv: "2ae9021e7826d47349de7da25cc3dca1"
server_key_version: "encryptionkey@0"
I20260807 20:20:39.182646 23653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:39.200809 23653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:39.202950 23653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:39.203075 23653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:39.203300 23653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:20:39.203776 23719 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 20:20:39.205300 23653 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 20:20:39.205353 23653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 20:20:39.205380 23653 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 20:20:39.206096 23653 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 20:20:39.206142 23653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 20:20:39.206202 23719 tablet_bootstrap.cc:492] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Bootstrap starting.
I20260807 20:20:39.213546 23653 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:38087
I20260807 20:20:39.213611 23875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:38087 every 8 connection(s)
I20260807 20:20:39.214233 23653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:20:39.217026 23719 log.cc:824] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:39.219376 23719 tablet_bootstrap.cc:492] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 20:20:39.219677 23719 tablet_bootstrap.cc:492] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Bootstrap complete.
I20260807 20:20:39.220620 23719 ts_tablet_manager.cc:1397] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.011s
Aug 07 20:20:39 dist-test-slave-t7g5 krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134039, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:20:39.221817 23719 raft_consensus.cc:348] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } }
I20260807 20:20:39.222151 23719 raft_consensus.cc:729] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b5e4b7d4d96484a8bcef3f7afd1fb3b, State: Initialized, Role: FOLLOWER
I20260807 20:20:39.222293 23719 consensus_queue.cc:260] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } }
I20260807 20:20:39.222559 23719 ts_tablet_manager.cc:1428] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
I20260807 20:20:39.224131 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 23653
I20260807 20:20:39.224436 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:33425
--local_ip_for_outbound_sockets=127.30.35.194
--tserver_master_addrs=127.30.35.254:41985
--webserver_port=34115
--webserver_interface=127.30.35.194
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:20:39.225298 23882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.214946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:46639)
0807 20:20:39.215135 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:39.215178 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:39.215656 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:39.216171 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:39.216174 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:39.216447 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:39.216640 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.216644 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.218159 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.218160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.218981 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.218984 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.219768 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.219769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.219893 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.220466 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:39.220475 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:39.222165 (+ 1690us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:39.223787 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:39.223794 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:39.223795 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:39.224015 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:39.224289 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:39.224289 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:39.224290 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:39.224393 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:39.224829 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:39.224835 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:39.224956 (+ 121us) client_negotiation.cc:769] Sending connection context
0807 20:20:39.225042 (+ 86us) client_negotiation.cc:240] Negotiation successful
0807 20:20:39.225163 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":100,"threads_started":1}
I20260807 20:20:39.225445 23883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.215055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:46639 (local address 127.30.35.254:41985)
0807 20:20:39.215272 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:39.215285 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:39.215324 (+ 39us) server_negotiation.cc:407] Connection header received
0807 20:20:39.215882 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:39.215891 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:39.215957 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:39.216130 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:39.216758 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.218044 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.219069 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.219655 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.219774 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.222286 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:39.222290 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:39.222290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:39.222302 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:39.223716 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:39.224091 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:39.224094 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:39.224095 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:39.224217 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:39.224455 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:39.224457 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:39.224457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:39.224746 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:39.224835 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:39.225119 (+ 284us) server_negotiation.cc:299] Negotiation successful
0807 20:20:39.225264 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":92,"threads_started":1}
I20260807 20:20:39.226073 23876 heartbeater.cc:347] Connected to a master server at 127.30.35.254:41985
I20260807 20:20:39.226182 23876 heartbeater.cc:464] Registering TS with master...
I20260807 20:20:39.226356 23876 heartbeater.cc:511] Master 127.30.35.254:41985 requested a full tablet report, sending...
I20260807 20:20:39.227080 23604 ts_manager.cc:194] Registered new tserver with Master: 9b5e4b7d4d96484a8bcef3f7afd1fb3b (127.30.35.193:38087)
I20260807 20:20:39.228024 23604 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:46639
I20260807 20:20:39.228909 23876 heartbeater.cc:503] Master 127.30.35.254:41985 was elected leader, sending a full tablet report...
Aug 07 20:20:39 dist-test-slave-t7g5 krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134039, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for kudu/127.30.35.193@KRBTEST.COM
I20260807 20:20:39.235845 23893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.227715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34764 (local address 127.30.35.193:38087)
0807 20:20:39.228054 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:39.228059 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:39.228067 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:20:39.228096 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:39.228097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:39.228111 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:39.228163 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:39.228755 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.229578 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.230620 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.230969 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.231024 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.233274 (+ 2250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:39.233281 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:39.233282 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:39.233288 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:39.234677 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:39.235111 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:39.235113 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:39.235113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:39.235161 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:39.235339 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:39.235339 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:39.235339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:39.235478 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:39.235537 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:39.235717 (+ 180us) server_negotiation.cc:299] Negotiation successful
0807 20:20:39.235785 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":71,"threads_started":1}
I20260807 20:20:39.235915 23892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.227642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:38087 (local address 127.0.0.1:34764)
0807 20:20:39.227839 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:39.227869 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:39.227928 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:39.228219 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:39.228225 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:39.228616 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:39.228676 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.228679 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.229676 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.229677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.230542 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.230546 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.231043 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.231045 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.231131 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.231554 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:39.231560 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:39.233193 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:39.234753 (+ 1560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:39.234762 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:39.234764 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:39.235036 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:39.235215 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:39.235216 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:39.235216 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:39.235285 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:39.235540 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:39.235547 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:39.235603 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 20:20:39.235696 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 20:20:39.235815 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":76,"threads_started":1}
I20260807 20:20:39.236323 23784 tablet_service.cc:1514] Processing DeleteTablet for tablet a780c3d8e89e4477b5d30fdf287d093b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:20:18 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:34764
I20260807 20:20:39.236776 23897 tablet_replica.cc:330] stopping tablet replica
I20260807 20:20:39.236864 23897 raft_consensus.cc:2229] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:20:39.236938 23897 raft_consensus.cc:2258] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:20:39.237213 23897 ts_tablet_manager.cc:1905] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:20:39.239183 23897 ts_tablet_manager.cc:1918] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:20:39.239246 23897 log.cc:1196] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal/wals/a780c3d8e89e4477b5d30fdf287d093b
I20260807 20:20:39.239452 23897 ts_tablet_manager.cc:1939] T a780c3d8e89e4477b5d30fdf287d093b P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Deleting consensus metadata
I20260807 20:20:39.239908 23586 catalog_manager.cc:4841] TS 9b5e4b7d4d96484a8bcef3f7afd1fb3b (127.30.35.193:38087): tablet a780c3d8e89e4477b5d30fdf287d093b (table test-table [id=3026378b06434777892cdead1e527776]) successfully deleted
W20260807 20:20:39.307452 23890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:39.307659 23890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:39.307691 23890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:39.308821 23890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:39.308864 23890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:39.308899 23890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:20:39.310395 23890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:33425
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=34115
--tserver_master_addrs=127.30.35.254:41985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:39.310662 23890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:39.310875 23890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:20:39.316025 23909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:39.315991 23904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:39.315986 23905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:39.316684 23890 server_base.cc:1034] running on GCE node
I20260807 20:20:39.316887 23890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:39.317108 23890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:39.318240 23890 hybrid_clock.cc:648] HybridClock initialized: now 1786134039318223 us; error 30 us; skew 500 ppm
Aug 07 20:20:39 dist-test-slave-t7g5 krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134039, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:39.320721 23890 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:20:39.321170 23890 webserver.cc:460] Webserver started at http://127.30.35.194:34115/ using document root <none> and password file <none>
I20260807 20:20:39.321396 23890 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:39.321462 23890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:39.322849 23890 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:20:39.323382 23918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:39.323547 23890 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:20:39.323637 23890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "19caff2bac0a4095ad68bb052590d1e6"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "003aa343c43c3be332eac4c78727b38c"
server_key_iv: "c8380265c61281b36b2b738b7e9b234b"
server_key_version: "encryptionkey@0"
I20260807 20:20:39.323983 23890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:39.337087 23890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:39.339376 23890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:39.339527 23890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:39.339754 23890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:20:39.340068 23890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:20:39.340104 23890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:39.340135 23890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:20:39.340160 23890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:39.345724 23890 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:33425
I20260807 20:20:39.345788 24081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:33425 every 8 connection(s)
I20260807 20:20:39.346132 23890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:20:39.351257 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 23890
I20260807 20:20:39.351565 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:42143
--local_ip_for_outbound_sockets=127.30.35.195
--tserver_master_addrs=127.30.35.254:41985
--webserver_port=34041
--webserver_interface=127.30.35.195
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 20:20:39 dist-test-slave-t7g5 krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134039, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:20:39.355114 23883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.346814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:50075 (local address 127.30.35.254:41985)
0807 20:20:39.346897 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:39.346899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:39.347083 (+ 184us) server_negotiation.cc:407] Connection header received
0807 20:20:39.347555 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:39.347557 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:39.347572 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:39.347618 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:39.348540 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.349028 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.350050 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.350241 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.350284 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.352482 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:39.352484 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:39.352484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:39.352492 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:39.353825 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:39.354200 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:39.354202 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:39.354202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:39.354261 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:39.354493 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:39.354493 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:39.354494 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:39.354610 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:39.354666 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:39.354923 (+ 257us) server_negotiation.cc:299] Negotiation successful
0807 20:20:39.355021 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260807 20:20:39.355268 24086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.346784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:50075)
0807 20:20:39.346949 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:39.346989 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:39.347478 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:39.347683 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:39.347686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:39.348253 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:39.348468 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.348474 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.349092 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.349093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.349992 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.349995 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.350298 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.350298 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.350408 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.350845 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:39.350853 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:39.352369 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:39.353900 (+ 1531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:39.353908 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:39.353910 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:39.354132 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:39.354330 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:39.354331 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:39.354331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:39.354436 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:39.354664 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:39.354671 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:39.354806 (+ 135us) client_negotiation.cc:769] Sending connection context
0807 20:20:39.354895 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 20:20:39.355058 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":86,"threads_started":1}
I20260807 20:20:39.355734 24082 heartbeater.cc:347] Connected to a master server at 127.30.35.254:41985
I20260807 20:20:39.355847 24082 heartbeater.cc:464] Registering TS with master...
I20260807 20:20:39.356060 24082 heartbeater.cc:511] Master 127.30.35.254:41985 requested a full tablet report, sending...
I20260807 20:20:39.356484 23604 ts_manager.cc:194] Registered new tserver with Master: 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425)
I20260807 20:20:39.356841 23604 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:50075
W20260807 20:20:39.433238 24087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:39.433452 24087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:39.433475 24087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:39.434633 24087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:39.434675 24087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:39.434705 24087 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:20:39.436141 24087 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:42143
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=34041
--tserver_master_addrs=127.30.35.254:41985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:39.436352 24087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:39.436561 24087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:20:39.441231 24096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:39.441285 24093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:39.441358 24087 server_base.cc:1034] running on GCE node
W20260807 20:20:39.441318 24092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:39.441716 24087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:39.441951 24087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:39.443091 24087 hybrid_clock.cc:648] HybridClock initialized: now 1786134039443075 us; error 35 us; skew 500 ppm
Aug 07 20:20:39 dist-test-slave-t7g5 krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134039, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:39.445405 24087 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:20:39.445851 24087 webserver.cc:460] Webserver started at http://127.30.35.195:34041/ using document root <none> and password file <none>
I20260807 20:20:39.446060 24087 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:39.446125 24087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:39.447364 24087 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:20:39.447929 24107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:39.448077 24087 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:20:39.448171 24087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "06d1e7efbd6f403486c5290743f84ef9"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "c4dd12d9798491a6dbfc9bab1d17ff90"
server_key_iv: "cb50a745128944c07e28dc4f81968b13"
server_key_version: "encryptionkey@0"
I20260807 20:20:39.448485 24087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:39.465165 24087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:39.466960 24087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:39.467093 24087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:39.467301 24087 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:20:39.467581 24087 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:20:39.467614 24087 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:39.467643 24087 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:20:39.467666 24087 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:39.472947 24087 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:42143
I20260807 20:20:39.472991 24273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:42143 every 8 connection(s)
I20260807 20:20:39.473317 24087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:20:39.477200 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 24087
Aug 07 20:20:39 dist-test-slave-t7g5 krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134039, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:20:39.482594 23883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.474012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:33963 (local address 127.30.35.254:41985)
0807 20:20:39.474073 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:39.474075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:39.474262 (+ 187us) server_negotiation.cc:407] Connection header received
0807 20:20:39.474759 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:39.474761 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:39.474774 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:39.474828 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:39.475763 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.476241 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.477283 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.477538 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.477604 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.479839 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:39.479841 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:39.479841 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:39.479848 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:39.481226 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:39.481670 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:39.481671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:39.481672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:39.481726 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:39.481963 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:39.481964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:39.481964 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:39.482078 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:39.482144 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:39.482403 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 20:20:39.482496 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 20:20:39.482651 24278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.473979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:33963)
0807 20:20:39.474152 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:39.474188 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:39.474661 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:39.474901 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:39.474905 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:39.475484 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:20:39.475668 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.475673 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.476323 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.476324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.477188 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.477190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.477631 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.477632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.477789 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.478257 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:20:39.478266 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:20:39.479751 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:20:39.481310 (+ 1559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:39.481317 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:39.481319 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:39.481570 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:39.481792 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:20:39.481793 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:20:39.481793 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:20:39.481895 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:20:39.482142 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:20:39.482148 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:20:39.482284 (+ 136us) client_negotiation.cc:769] Sending connection context
0807 20:20:39.482368 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 20:20:39.482493 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":85,"threads_started":1}
I20260807 20:20:39.483072 24274 heartbeater.cc:347] Connected to a master server at 127.30.35.254:41985
I20260807 20:20:39.483176 24274 heartbeater.cc:464] Registering TS with master...
I20260807 20:20:39.483366 24274 heartbeater.cc:511] Master 127.30.35.254:41985 requested a full tablet report, sending...
I20260807 20:20:39.483807 23604 ts_manager.cc:194] Registered new tserver with Master: 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143)
I20260807 20:20:39.483906 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.477594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36204 (local address 127.30.35.254:41985)
0807 20:20:39.477729 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:39.477731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:39.477813 (+ 82us) server_negotiation.cc:407] Connection header received
0807 20:20:39.477852 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:39.477852 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:39.477863 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:39.477935 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:39.478474 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.479088 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.479957 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.480173 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.480228 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.481285 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:39.481286 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:39.481287 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:39.481293 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:39.482713 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:39.483072 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:39.483073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:39.483074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:39.483140 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:39.483351 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:39.483351 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:39.483352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:39.483478 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:39.483646 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:39.483689 (+ 43us) server_negotiation.cc:299] Negotiation successful
0807 20:20:39.483772 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":84,"threads_started":1}
I20260807 20:20:39.484285 23604 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:33963
I20260807 20:20:39.484560 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:20:39.487057 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.484891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36210 (local address 127.30.35.254:41985)
0807 20:20:39.484949 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:39.484951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:39.485060 (+ 109us) server_negotiation.cc:407] Connection header received
0807 20:20:39.485137 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:39.485137 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:39.485164 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:39.485215 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:20:39.485306 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.485841 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.486538 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.486716 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.486758 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.486856 (+ 98us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:20:39.486891 (+ 35us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 20:20:39.487007 (+ 116us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36210: token expired
Metrics: {"server-negotiator.queue_time_us":38}
W20260807 20:20:39.487112 24280 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36210: token expired
W20260807 20:20:39.487859 23505 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.30.35.254:41985)
I20260807 20:20:39.492589 24280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.488082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36214 (local address 127.30.35.254:41985)
0807 20:20:39.488115 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:39.488116 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:39.488122 (+ 6us) server_negotiation.cc:407] Connection header received
0807 20:20:39.488139 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:39.488140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:39.488146 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:39.488185 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:20:39.488576 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.488983 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.489569 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.489765 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.489808 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.490785 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:20:39.490785 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:20:39.490786 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:20:39.490790 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:20:39.491862 (+ 1072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:39.492127 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:39.492127 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:39.492127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:39.492170 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:20:39.492276 (+ 106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:20:39.492277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:20:39.492277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:20:39.492351 (+ 74us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:20:39.492411 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:39.492479 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 20:20:39.492529 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 20:20:39.493703 23603 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36214:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:20:39.495163 23603 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:20:39.497347 23784 tablet_service.cc:1467] Processing CreateTablet for tablet 68a7a1520a404ba4bf3d783363b503dc (DEFAULT_TABLE table=test-table [id=1292ff39ad6542e0a6ec7b1a43be2bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:20:39.497571 23784 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68a7a1520a404ba4bf3d783363b503dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:20:39.499490 23719 tablet_bootstrap.cc:492] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Bootstrap starting.
I20260807 20:20:39.499832 23719 tablet_bootstrap.cc:654] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Neither blocks nor log segments found. Creating new log.
I20260807 20:20:39.500370 23892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.496804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:33425 (local address 127.0.0.1:45352)
0807 20:20:39.496847 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:39.496859 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:39.496901 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:39.497282 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:39.497283 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:39.497285 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:39.497336 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.497337 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.498397 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.498398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.499362 (+ 964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.499364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.500137 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.500138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.500212 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.500235 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 20:20:39.500263 (+ 28us) client_negotiation.cc:240] Negotiation successful
0807 20:20:39.500304 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 20:20:39.500401 23719 tablet_bootstrap.cc:492] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: No bootstrap required, opened a new log
I20260807 20:20:39.500454 23719 ts_tablet_manager.cc:1397] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260807 20:20:39.500721 24285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.496917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45352 (local address 127.30.35.194:33425)
0807 20:20:39.497096 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:39.497100 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:39.497110 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:20:39.497149 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:39.497151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:39.497167 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:39.497249 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:39.497399 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.498326 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.499455 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.500039 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.500489 (+ 450us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.500558 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:39.500585 (+ 27us) server_negotiation.cc:299] Negotiation successful
0807 20:20:39.500630 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":87,"threads_started":1}
I20260807 20:20:39.500833 24283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.496869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:42143 (local address 127.0.0.1:41040)
0807 20:20:39.497012 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:39.497020 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:39.497054 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:39.497622 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:39.497623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:39.497625 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:39.497686 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.497687 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.498806 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.498807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.499778 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.499782 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.500632 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.500633 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.500701 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.500705 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:20:39.500734 (+ 29us) client_negotiation.cc:240] Negotiation successful
0807 20:20:39.500771 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":108,"threads_started":1}
I20260807 20:20:39.500808 23719 raft_consensus.cc:348] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:20:39.500881 23719 raft_consensus.cc:374] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:20:39.500926 23719 raft_consensus.cc:729] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b5e4b7d4d96484a8bcef3f7afd1fb3b, State: Initialized, Role: FOLLOWER
I20260807 20:20:39.500975 23719 consensus_queue.cc:260] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:20:39.501073 23719 ts_tablet_manager.cc:1428] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260807 20:20:39.501192 24286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.497142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41040 (local address 127.30.35.195:42143)
0807 20:20:39.497472 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:39.497477 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:39.497485 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:20:39.497517 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:39.497519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:39.497532 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:39.497608 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:39.497787 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.498720 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.499862 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.500541 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.500941 (+ 400us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.501002 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:39.501026 (+ 24us) server_negotiation.cc:299] Negotiation successful
0807 20:20:39.501120 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":78,"threads_started":1}
I20260807 20:20:39.501386 23988 tablet_service.cc:1467] Processing CreateTablet for tablet 68a7a1520a404ba4bf3d783363b503dc (DEFAULT_TABLE table=test-table [id=1292ff39ad6542e0a6ec7b1a43be2bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:20:39.501727 23988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68a7a1520a404ba4bf3d783363b503dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:20:39.504662 24288 tablet_bootstrap.cc:492] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6: Bootstrap starting.
I20260807 20:20:39.504980 24182 tablet_service.cc:1467] Processing CreateTablet for tablet 68a7a1520a404ba4bf3d783363b503dc (DEFAULT_TABLE table=test-table [id=1292ff39ad6542e0a6ec7b1a43be2bf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:20:39.505261 24182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68a7a1520a404ba4bf3d783363b503dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:20:39.505280 24288 tablet_bootstrap.cc:654] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6: Neither blocks nor log segments found. Creating new log.
I20260807 20:20:39.505779 24288 log.cc:824] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:39.506484 24288 tablet_bootstrap.cc:492] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6: No bootstrap required, opened a new log
I20260807 20:20:39.506541 24288 ts_tablet_manager.cc:1397] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:20:39.507802 24288 raft_consensus.cc:348] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:20:39.507951 24288 raft_consensus.cc:374] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:20:39.507937 24290 tablet_bootstrap.cc:492] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9: Bootstrap starting.
I20260807 20:20:39.507989 24288 raft_consensus.cc:729] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19caff2bac0a4095ad68bb052590d1e6, State: Initialized, Role: FOLLOWER
I20260807 20:20:39.508136 24288 consensus_queue.cc:260] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:20:39.508414 24288 ts_tablet_manager.cc:1428] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:20:39.508433 24082 heartbeater.cc:503] Master 127.30.35.254:41985 was elected leader, sending a full tablet report...
I20260807 20:20:39.508564 24290 tablet_bootstrap.cc:654] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9: Neither blocks nor log segments found. Creating new log.
I20260807 20:20:39.509104 24290 log.cc:824] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:39.509827 24290 tablet_bootstrap.cc:492] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9: No bootstrap required, opened a new log
I20260807 20:20:39.509891 24290 ts_tablet_manager.cc:1397] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:20:39.511286 24290 raft_consensus.cc:348] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:20:39.511422 24290 raft_consensus.cc:374] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:20:39.511464 24290 raft_consensus.cc:729] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06d1e7efbd6f403486c5290743f84ef9, State: Initialized, Role: FOLLOWER
I20260807 20:20:39.511576 24290 consensus_queue.cc:260] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:20:39.511818 24290 ts_tablet_manager.cc:1428] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:20:39.511866 24274 heartbeater.cc:503] Master 127.30.35.254:41985 was elected leader, sending a full tablet report...
W20260807 20:20:39.596737 24084 tablet.cc:2369] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:20:39.715130 23881 tablet.cc:2369] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:20:39.720870 24292 raft_consensus.cc:482] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:20:39.720979 24292 raft_consensus.cc:504] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:20:39.721333 24292 leader_election.cc:288] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143), 9b5e4b7d4d96484a8bcef3f7afd1fb3b (127.30.35.193:38087)
W20260807 20:20:39.723826 24275 tablet.cc:2369] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:20:39.724750 24086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.721508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:42143 (local address 127.30.35.194:57247)
0807 20:20:39.721558 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:39.721572 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:39.721631 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:39.721806 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:39.721807 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:39.721809 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:39.721889 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.721891 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.722752 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.722752 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.723925 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.723928 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.724497 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.724498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.724577 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.724582 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:20:39.724633 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 20:20:39.724672 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32,"mutex_wait_us":41}
I20260807 20:20:39.724763 24286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.721615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:57247 (local address 127.30.35.195:42143)
0807 20:20:39.721680 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:39.721683 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:39.721692 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:20:39.721726 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:39.721726 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:39.721737 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:39.721798 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:39.721963 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.722682 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.724031 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.724413 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.724473 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.724480 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:39.724653 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 20:20:39.724695 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260807 20:20:39.724870 24299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.721634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:38087 (local address 127.30.35.194:41485)
0807 20:20:39.721868 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:39.721876 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:20:39.721931 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:20:39.722079 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:20:39.722079 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:20:39.722080 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:20:39.722132 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.722133 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.722921 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.722921 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.724029 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:20:39.724031 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.724625 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.724626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:20:39.724704 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.724708 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:20:39.724760 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 20:20:39.724800 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":141,"threads_started":1}
I20260807 20:20:39.724885 23893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.721736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:41485 (local address 127.30.35.193:38087)
0807 20:20:39.721790 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:39.721791 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:39.721940 (+ 149us) server_negotiation.cc:407] Connection header received
0807 20:20:39.721984 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:39.721985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:39.722011 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:39.722072 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:20:39.722190 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.722861 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.724101 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.724535 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.724603 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.724682 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:39.724772 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 20:20:39.724817 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 20:20:39.725155 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a7a1520a404ba4bf3d783363b503dc" candidate_uuid: "19caff2bac0a4095ad68bb052590d1e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" is_pre_election: true
I20260807 20:20:39.725212 24207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a7a1520a404ba4bf3d783363b503dc" candidate_uuid: "19caff2bac0a4095ad68bb052590d1e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06d1e7efbd6f403486c5290743f84ef9" is_pre_election: true
I20260807 20:20:39.725291 23814 raft_consensus.cc:2454] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19caff2bac0a4095ad68bb052590d1e6 in term 0.
I20260807 20:20:39.725347 24207 raft_consensus.cc:2454] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19caff2bac0a4095ad68bb052590d1e6 in term 0.
I20260807 20:20:39.725533 23922 leader_election.cc:302] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19caff2bac0a4095ad68bb052590d1e6, 9b5e4b7d4d96484a8bcef3f7afd1fb3b; no voters:
I20260807 20:20:39.725682 24292 raft_consensus.cc:2781] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:20:39.725744 24292 raft_consensus.cc:482] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:20:39.725771 24292 raft_consensus.cc:3037] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:20:39.726547 24292 raft_consensus.cc:504] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:20:39.726657 24292 leader_election.cc:288] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [CANDIDATE]: Term 1 election: Requested vote from peers 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143), 9b5e4b7d4d96484a8bcef3f7afd1fb3b (127.30.35.193:38087)
I20260807 20:20:39.726807 24207 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a7a1520a404ba4bf3d783363b503dc" candidate_uuid: "19caff2bac0a4095ad68bb052590d1e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06d1e7efbd6f403486c5290743f84ef9"
I20260807 20:20:39.726811 23814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68a7a1520a404ba4bf3d783363b503dc" candidate_uuid: "19caff2bac0a4095ad68bb052590d1e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b"
I20260807 20:20:39.726881 23814 raft_consensus.cc:3037] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:20:39.726881 24207 raft_consensus.cc:3037] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:20:39.727658 24207 raft_consensus.cc:2454] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19caff2bac0a4095ad68bb052590d1e6 in term 1.
I20260807 20:20:39.727658 23814 raft_consensus.cc:2454] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19caff2bac0a4095ad68bb052590d1e6 in term 1.
I20260807 20:20:39.727847 23922 leader_election.cc:302] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06d1e7efbd6f403486c5290743f84ef9, 19caff2bac0a4095ad68bb052590d1e6; no voters:
I20260807 20:20:39.727975 24292 raft_consensus.cc:2781] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:20:39.728122 24292 raft_consensus.cc:686] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [term 1 LEADER]: Becoming Leader. State: Replica: 19caff2bac0a4095ad68bb052590d1e6, State: Running, Role: LEADER
I20260807 20:20:39.728220 24292 consensus_queue.cc:237] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:20:39.728948 23603 catalog_manager.cc:5495] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194). New cstate: current_term: 1 leader_uuid: "19caff2bac0a4095ad68bb052590d1e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } health_report { overall_health: UNKNOWN } } }
I20260807 20:20:39.786762 24285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.784553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45360 (local address 127.30.35.194:33425)
0807 20:20:39.784604 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 20:20:39.784606 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:20:39.784615 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:20:39.784654 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:20:39.784655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:20:39.784675 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:20:39.784749 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:20:39.784855 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.785344 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.786096 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:20:39.786298 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:20:39.786348 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:20:39.786482 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:20:39.786591 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:20:39.786651 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 20:20:39.786664 (+ 13us) server_negotiation.cc:299] Negotiation successful
0807 20:20:39.786682 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 20:20:39.788584 24207 raft_consensus.cc:1261] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9 [term 1 FOLLOWER]: Refusing update from remote peer 19caff2bac0a4095ad68bb052590d1e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:20:39.788592 23814 raft_consensus.cc:1261] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Refusing update from remote peer 19caff2bac0a4095ad68bb052590d1e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:20:39.788930 24300 consensus_queue.cc:1035] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:20:39.789062 24292 consensus_queue.cc:1035] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:20:39.794413 23604 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:20:39.794505 23604 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:20:39.795179 23604 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Sending DeleteTablet for 3 replicas of tablet 68a7a1520a404ba4bf3d783363b503dc
I20260807 20:20:39.795604 23988 tablet_service.cc:1514] Processing DeleteTablet for tablet 68a7a1520a404ba4bf3d783363b503dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:20:39 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:45352
I20260807 20:20:39.795655 24182 tablet_service.cc:1514] Processing DeleteTablet for tablet 68a7a1520a404ba4bf3d783363b503dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:20:39 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:41040
I20260807 20:20:39.795857 23784 tablet_service.cc:1514] Processing DeleteTablet for tablet 68a7a1520a404ba4bf3d783363b503dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:20:39 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:34764
I20260807 20:20:39.795897 24321 tablet_replica.cc:330] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9: stopping tablet replica
I20260807 20:20:39.795889 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 23653
I20260807 20:20:39.795989 24321 raft_consensus.cc:2229] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:20:39.796078 24321 raft_consensus.cc:2258] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:20:39.798489 24320 tablet_replica.cc:330] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6: stopping tablet replica
I20260807 20:20:39.798648 24320 raft_consensus.cc:2229] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:20:39.798789 24320 raft_consensus.cc:2258] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:20:39.804425 24320 ts_tablet_manager.cc:1905] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:20:39.806171 24320 ts_tablet_manager.cc:1918] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:20:39.806269 24320 log.cc:1196] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/68a7a1520a404ba4bf3d783363b503dc
I20260807 20:20:39.806578 24320 ts_tablet_manager.cc:1939] T 68a7a1520a404ba4bf3d783363b503dc P 19caff2bac0a4095ad68bb052590d1e6: Deleting consensus metadata
I20260807 20:20:39.810243 23586 catalog_manager.cc:4841] TS 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425): tablet 68a7a1520a404ba4bf3d783363b503dc (table test-table [id=1292ff39ad6542e0a6ec7b1a43be2bf4]) successfully deleted
I20260807 20:20:39.811623 24321 ts_tablet_manager.cc:1905] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:20:39.813450 24321 ts_tablet_manager.cc:1918] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:20:39.813524 24321 log.cc:1196] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/68a7a1520a404ba4bf3d783363b503dc
I20260807 20:20:39.813786 24321 ts_tablet_manager.cc:1939] T 68a7a1520a404ba4bf3d783363b503dc P 06d1e7efbd6f403486c5290743f84ef9: Deleting consensus metadata
I20260807 20:20:39.814167 23586 catalog_manager.cc:4841] TS 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143): tablet 68a7a1520a404ba4bf3d783363b503dc (table test-table [id=1292ff39ad6542e0a6ec7b1a43be2bf4]) successfully deleted
W20260807 20:20:39.817685 23586 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:38087 (error 108)
I20260807 20:20:39.817903 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 23890
I20260807 20:20:39.819404 24283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:20:39.818018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:38087 (local address 127.0.0.1:34776)
0807 20:20:39.819300 (+ 1282us) negotiation.cc:107] Waiting for socket to connect
0807 20:20:39.819364 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:38087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1254}
W20260807 20:20:39.821827 23586 catalog_manager.cc:4584] TS 9b5e4b7d4d96484a8bcef3f7afd1fb3b (127.30.35.193:38087): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 68a7a1520a404ba4bf3d783363b503dc: Network error: Client connection negotiation failed: client connection to 127.30.35.193:38087: connect: Connection refused (error 111)
I20260807 20:20:39.834796 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 24087
I20260807 20:20:39.843375 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 23558
I20260807 20:20:59.853966 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:41985
--webserver_interface=127.30.35.254
--webserver_port=42391
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:41985
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:20:59.938951 24323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:20:59.939195 24323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:20:59.939240 24323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:20:59.940394 24323 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 20:20:59.940441 24323 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 20:20:59.940462 24323 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 20:20:59.940480 24323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:20:59.940500 24323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:20:59.940521 24323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:20:59.940548 24323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:20:59.940569 24323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:20:59.942127 24323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:41985
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:41985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=42391
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:20:59.942405 24323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:20:59.942629 24323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 20:20:59.947703 24323 server_base.cc:1034] running on GCE node
W20260807 20:20:59.947889 24336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:59.947908 24333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:20:59.947819 24329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:20:59.948259 24323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:20:59.948549 24323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:20:59.949707 24323 hybrid_clock.cc:648] HybridClock initialized: now 1786134059949689 us; error 35 us; skew 500 ppm
Aug 07 20:20:59 dist-test-slave-t7g5 krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134059, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:20:59.954973 24323 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:20:59.955412 24323 webserver.cc:460] Webserver started at http://127.30.35.254:42391/ using document root <none> and password file <none>
I20260807 20:20:59.955649 24323 fs_manager.cc:359] Metadata directory not provided
I20260807 20:20:59.955701 24323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:20:59.957185 24323 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:20:59.957890 24346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:20:59.958050 24323 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:20:59.958148 24323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "ca84d6566fd94c4591ddff0be7364238"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "785a34d8e88a5b2675d1c60f484a6db3"
server_key_iv: "38b0e594a1d0566ceb4d2e3d05b7435c"
server_key_version: "encryptionkey@0"
I20260807 20:20:59.958508 24323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:20:59.976781 24323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:20:59.978570 24323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:20:59.978710 24323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:20:59.982676 24323 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:41985
I20260807 20:20:59.982726 24418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:41985 every 8 connection(s)
I20260807 20:20:59.983078 24323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:20:59.984565 24419 sys_catalog.cc:263] Verifying existing consensus state
I20260807 20:20:59.985239 24419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Bootstrap starting.
I20260807 20:20:59.990963 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 24323
I20260807 20:20:59.991251 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:38087
--local_ip_for_outbound_sockets=127.30.35.193
--tserver_master_addrs=127.30.35.254:41985
--webserver_port=37363
--webserver_interface=127.30.35.193
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:20:59.993927 24419 log.cc:824] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Log is configured to *not* fsync() on all Append() calls
I20260807 20:20:59.996111 24419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 20:20:59.996378 24419 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Bootstrap complete.
I20260807 20:20:59.998477 24419 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } }
I20260807 20:20:59.998701 24419 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca84d6566fd94c4591ddff0be7364238, State: Initialized, Role: FOLLOWER
I20260807 20:20:59.998850 24419 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } }
I20260807 20:20:59.998927 24419 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:20:59.998977 24419 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:20:59.999025 24419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 2 FOLLOWER]: Advancing to term 3
I20260807 20:20:59.999970 24419 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } }
I20260807 20:21:00.000088 24419 leader_election.cc:302] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca84d6566fd94c4591ddff0be7364238; no voters:
I20260807 20:21:00.000252 24419 leader_election.cc:288] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 20:21:00.000319 24427 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 3 FOLLOWER]: Leader election won for term 3
I20260807 20:21:00.000526 24419 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:00.000542 24427 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [term 3 LEADER]: Becoming Leader. State: Replica: ca84d6566fd94c4591ddff0be7364238, State: Running, Role: LEADER
I20260807 20:21:00.000712 24427 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } }
I20260807 20:21:00.001116 24430 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca84d6566fd94c4591ddff0be7364238. Latest consensus state: current_term: 3 leader_uuid: "ca84d6566fd94c4591ddff0be7364238" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } } }
I20260807 20:21:00.001206 24430 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:00.001288 24429 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ca84d6566fd94c4591ddff0be7364238" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca84d6566fd94c4591ddff0be7364238" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 41985 } } }
I20260807 20:21:00.001363 24429 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:00.001703 24441 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:00.002578 24441 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:00.002686 24441 catalog_manager.cc:1259] Loaded cluster ID: d300c016a7264423afebc2e55fe2be7e
I20260807 20:21:00.002717 24441 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:00.003873 24441 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:00.004079 24441 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Loaded TSK: 0
I20260807 20:21:00.004133 24441 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ca84d6566fd94c4591ddff0be7364238: Loaded TSK: 1
F20260807 20:21:00.004359 24441 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fc6ced929ad google::LogMessage::Fail() at ??:0
@ 0x7fc6ced9588a google::LogMessage::SendToLog() at ??:0
@ 0x7fc6ced924de google::LogMessage::Flush() at ??:0
@ 0x7fc6ced93a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc6d14ff104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fc6d14fcd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fc6d6cf01cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fc6d6cf048e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fc6d6cf0594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fc6d6cb6c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fc6d6cc0ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fc6d0c600d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc6d0c55954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc6d1ab96db start_thread at ??:0
@ 0x7fc6cd89061f clone at ??:0
W20260807 20:21:00.090922 24423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:00.091137 24423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:00.091161 24423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:00.092303 24423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:00.092347 24423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:00.092372 24423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:21:00.093848 24423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:38087
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=37363
--tserver_master_addrs=127.30.35.254:41985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:00.094069 24423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:00.094285 24423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:00.099145 24481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:00.099335 24423 server_base.cc:1034] running on GCE node
W20260807 20:21:00.099159 24482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:00.099159 24484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:00.099649 24423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:00.099934 24423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:00.101104 24423 hybrid_clock.cc:648] HybridClock initialized: now 1786134060101091 us; error 29 us; skew 500 ppm
Aug 07 20:21:00 dist-test-slave-t7g5 krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134060, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:00.103742 24423 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:21:00.104225 24423 webserver.cc:460] Webserver started at http://127.30.35.193:37363/ using document root <none> and password file <none>
I20260807 20:21:00.104429 24423 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:00.104480 24423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:00.105909 24423 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:21:00.106563 24493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:00.106812 24423 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260807 20:21:00.106906 24423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "85a6ddd4190420b30b8d9f0f3e31c300"
server_key_iv: "2ae9021e7826d47349de7da25cc3dca1"
server_key_version: "encryptionkey@0"
I20260807 20:21:00.107245 24423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:00.134352 24423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:00.136534 24423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:00.136677 24423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:00.136914 24423 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:00.137372 24504 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260807 20:21:00.139420 24423 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 20:21:00.139472 24423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260807 20:21:00.139508 24423 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 20:21:00.140175 24423 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 20:21:00.140210 24423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260807 20:21:00.140300 24504 tablet_bootstrap.cc:492] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Bootstrap starting.
I20260807 20:21:00.146926 24423 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:38087
I20260807 20:21:00.147004 24651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:38087 every 8 connection(s)
I20260807 20:21:00.147333 24423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:21:00.152824 24504 log.cc:824] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:00.155651 24504 tablet_bootstrap.cc:492] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 20:21:00.156016 24504 tablet_bootstrap.cc:492] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Bootstrap complete.
I20260807 20:21:00.157182 24504 ts_tablet_manager.cc:1397] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.005s
I20260807 20:21:00.157493 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 24423
I20260807 20:21:00.157835 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:33425
--local_ip_for_outbound_sockets=127.30.35.194
--tserver_master_addrs=127.30.35.254:41985
--webserver_port=34115
--webserver_interface=127.30.35.194
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:21:00.158717 24504 raft_consensus.cc:348] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:21:00.159080 24504 raft_consensus.cc:729] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b5e4b7d4d96484a8bcef3f7afd1fb3b, State: Initialized, Role: FOLLOWER
I20260807 20:21:00.159235 24504 consensus_queue.cc:260] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:21:00.159534 24504 ts_tablet_manager.cc:1428] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b: Time spent starting tablet: real 0.002s user 0.006s sys 0.000s
W20260807 20:21:00.216014 24658 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:00.147957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:41701)
0807 20:21:00.148120 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:00.148163 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:00.148602 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:00.215803 (+ 67201us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":91,"threads_started":1}
W20260807 20:21:00.216274 24654 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:41985 (0 consecutive failures): Network error: Failed to ping master at 127.30.35.254:41985: Client connection negotiation failed: client connection to 127.30.35.254:41985: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 20:21:00.216625 24658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:00.216503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:59353)
0807 20:21:00.216557 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:00.216597 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 20:21:00.216948 24658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:00.216865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:55469)
0807 20:21:00.216904 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:00.216927 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260807 20:21:00.217042 24654 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 20:21:00.259459 24664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:00.259665 24664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:00.259696 24664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:00.260818 24664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:00.260861 24664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:00.260896 24664 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:21:00.262369 24664 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:33425
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=34115
--tserver_master_addrs=127.30.35.254:41985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:00.262606 24664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:00.262812 24664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:00.267658 24671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:00.267664 24673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:00.267668 24670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:00.267884 24664 server_base.cc:1034] running on GCE node
I20260807 20:21:00.268075 24664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:00.268292 24664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:00.269433 24664 hybrid_clock.cc:648] HybridClock initialized: now 1786134060269413 us; error 37 us; skew 500 ppm
Aug 07 20:21:00 dist-test-slave-t7g5 krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134060, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:00.271862 24664 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:21:00.272270 24664 webserver.cc:460] Webserver started at http://127.30.35.194:34115/ using document root <none> and password file <none>
I20260807 20:21:00.272500 24664 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:00.272550 24664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:00.273836 24664 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:21:00.274363 24681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:00.274513 24664 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:00.274595 24664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "19caff2bac0a4095ad68bb052590d1e6"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "003aa343c43c3be332eac4c78727b38c"
server_key_iv: "c8380265c61281b36b2b738b7e9b234b"
server_key_version: "encryptionkey@0"
I20260807 20:21:00.274919 24664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:00.294307 24664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:00.296166 24664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:00.296298 24664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:00.296510 24664 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:00.296799 24664 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:00.296833 24664 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:00.296861 24664 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:00.296880 24664 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:00.302492 24664 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:33425
I20260807 20:21:00.302557 24845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:33425 every 8 connection(s)
I20260807 20:21:00.302865 24664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:21:00.303851 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:00.303485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:52445)
0807 20:21:00.303638 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:00.303710 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":79,"threads_started":1}
W20260807 20:21:00.304245 24846 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:41985 (0 consecutive failures): Network error: Failed to ping master at 127.30.35.254:41985: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
I20260807 20:21:00.304509 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:00.304426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:46531)
0807 20:21:00.304465 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:00.304492 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260807 20:21:00.304764 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 24664
I20260807 20:21:00.304803 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:00.304731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:36115)
0807 20:21:00.304769 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:00.304789 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260807 20:21:00.304922 24846 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 20:21:00.305073 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:42143
--local_ip_for_outbound_sockets=127.30.35.195
--tserver_master_addrs=127.30.35.254:41985
--webserver_port=34041
--webserver_interface=127.30.35.195
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:00.386551 24853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:00.386759 24853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:00.386780 24853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:00.387928 24853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:00.387981 24853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:00.388007 24853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:21:00.389477 24853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:42143
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=34041
--tserver_master_addrs=127.30.35.254:41985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:00.389743 24853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:00.389972 24853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:00.394778 24859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:00.394855 24853 server_base.cc:1034] running on GCE node
W20260807 20:21:00.394822 24860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:00.394791 24863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:00.395252 24853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:00.395522 24853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:00.396672 24853 hybrid_clock.cc:648] HybridClock initialized: now 1786134060396662 us; error 28 us; skew 500 ppm
Aug 07 20:21:00 dist-test-slave-t7g5 krb5kdc[22764](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134060, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:00.399103 24853 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:21:00.399533 24853 webserver.cc:460] Webserver started at http://127.30.35.195:34041/ using document root <none> and password file <none>
I20260807 20:21:00.399753 24853 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:00.399802 24853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:00.401093 24853 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:21:00.401676 24872 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:00.401839 24853 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:21:00.401924 24853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "06d1e7efbd6f403486c5290743f84ef9"
format_stamp: "Formatted at 2026-08-07 20:20:18 on dist-test-slave-t7g5"
server_key: "c4dd12d9798491a6dbfc9bab1d17ff90"
server_key_iv: "cb50a745128944c07e28dc4f81968b13"
server_key_version: "encryptionkey@0"
I20260807 20:21:00.402251 24853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:00.424497 24853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:00.426399 24853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:00.426539 24853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:00.426769 24853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:00.427090 24853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:00.427125 24853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:00.427155 24853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:00.427172 24853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:00.432775 24853 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:42143
I20260807 20:21:00.432842 25026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:42143 every 8 connection(s)
I20260807 20:21:00.433166 24853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:21:00.434233 25029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:00.433865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:44949)
0807 20:21:00.434014 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:00.434087 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":75,"threads_started":1}
W20260807 20:21:00.434667 25027 heartbeater.cc:644] Failed to heartbeat to 127.30.35.254:41985 (0 consecutive failures): Network error: Failed to ping master at 127.30.35.254:41985: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
I20260807 20:21:00.434928 25029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:00.434841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:45261)
0807 20:21:00.434881 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:00.434909 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260807 20:21:00.435159 25029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:00.435092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:45865)
0807 20:21:00.435126 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:00.435146 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260807 20:21:00.435245 25027 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 20:21:00.440830 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 24853
I20260807 20:21:01.217614 25031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:01.217365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:44707)
0807 20:21:01.217497 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:01.217537 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":63,"threads_started":1}
I20260807 20:21:01.305445 25036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:01.305221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:53103)
0807 20:21:01.305356 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:01.305392 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":75,"threads_started":1}
I20260807 20:21:01.435839 25037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:01.435556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:54835)
0807 20:21:01.435697 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:01.435742 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":62,"threads_started":1}
I20260807 20:21:01.586907 25038 raft_consensus.cc:482] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:21:01.587046 25038 raft_consensus.cc:504] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:21:01.587389 25038 leader_election.cc:288] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425), 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143)
Aug 07 20:21:01 dist-test-slave-t7g5 krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134060, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.195@KRBTEST.COM
Aug 07 20:21:01 dist-test-slave-t7g5 krb5kdc[22764](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134060, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.194@KRBTEST.COM
I20260807 20:21:01.597611 25042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:01.587929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:44985 (local address 127.30.35.195:42143)
0807 20:21:01.588052 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:01.588063 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:01.588094 (+ 31us) server_negotiation.cc:407] Connection header received
0807 20:21:01.588508 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:01.588510 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:01.588549 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:01.588672 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:01.589422 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:01.590330 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:01.591340 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:01.591732 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:01.591828 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:01.594226 (+ 2398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:01.594231 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:01.594231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:01.594244 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:01.596069 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:01.596443 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:01.596446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:01.596447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:01.596540 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:01.596770 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:01.596771 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:01.596771 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:01.597017 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:01.597088 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:01.597365 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 20:21:01.597494 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":53,"threads_started":1}
I20260807 20:21:01.597610 25040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:01.587720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:40373 (local address 127.30.35.194:33425)
0807 20:21:01.587888 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:01.587902 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:01.587941 (+ 39us) server_negotiation.cc:407] Connection header received
0807 20:21:01.588423 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:01.588425 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:01.588470 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:01.588599 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:01.589408 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:01.590338 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:01.591332 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:01.591723 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:01.591821 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:01.594563 (+ 2742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:01.594567 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:01.594567 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:01.594581 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:01.596294 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:01.596604 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:01.596607 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:01.596607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:01.596699 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:01.596881 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:01.596882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:01.596882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:01.597102 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:01.597173 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:01.597378 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 20:21:01.597497 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
I20260807 20:21:01.597606 25039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:01.587710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:42143 (local address 127.30.35.193:44985)
0807 20:21:01.587863 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:01.587872 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:01.587926 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:01.588677 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:01.588678 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:01.589086 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:01.589293 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:01.589299 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:01.590429 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:01.590430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:01.591248 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:01.591250 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:01.591816 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:01.591817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:01.591929 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:01.592500 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:01.592510 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:01.594116 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:01.596144 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:01.596151 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:01.596153 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:01.596367 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:01.596600 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:01.596601 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:01.596601 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:01.596713 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:01.597082 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:01.597089 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:01.597214 (+ 125us) client_negotiation.cc:769] Sending connection context
0807 20:21:01.597303 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 20:21:01.597507 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":56,"thread_start_us":100,"threads_started":1}
I20260807 20:21:01.597872 25031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:01.587582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:33425 (local address 127.30.35.193:40373)
0807 20:21:01.587639 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:01.587652 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:01.587735 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:01.588654 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:01.588657 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:01.589084 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:01.589293 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:01.589299 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:01.590440 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:01.590440 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:01.591250 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:01.591252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:01.591810 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:01.591812 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:01.591927 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:01.592515 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:01.592520 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:01.594466 (+ 1946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:01.596374 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:01.596375 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:01.596375 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:01.596536 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:01.596761 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:01.596769 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:01.596769 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:01.596829 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:01.597168 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:01.597169 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:01.597220 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 20:21:01.597304 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 20:21:01.597585 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":188}
W20260807 20:21:01.598582 24499 leader_election.cc:341] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425): Not found: Tablet not found: 68a7a1520a404ba4bf3d783363b503dc
W20260807 20:21:01.598661 24499 leader_election.cc:341] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143): Not found: Tablet not found: 68a7a1520a404ba4bf3d783363b503dc
I20260807 20:21:01.598690 24499 leader_election.cc:302] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b5e4b7d4d96484a8bcef3f7afd1fb3b; no voters: 06d1e7efbd6f403486c5290743f84ef9, 19caff2bac0a4095ad68bb052590d1e6
I20260807 20:21:01.598809 25038 raft_consensus.cc:2726] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 20:21:02.218391 25043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:02.218160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:53369)
0807 20:21:02.218295 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:02.218331 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
I20260807 20:21:02.306077 25044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:02.305883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:33955)
0807 20:21:02.305994 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:02.306033 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":59,"threads_started":1}
I20260807 20:21:02.436476 25046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:02.436276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:59589)
0807 20:21:02.436385 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:02.436424 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":62,"threads_started":1}
I20260807 20:21:03.219046 25048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:03.218818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:46379)
0807 20:21:03.218958 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:03.218995 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
I20260807 20:21:03.223388 25049 raft_consensus.cc:482] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:21:03.223488 25049 raft_consensus.cc:504] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:21:03.223645 25049 leader_election.cc:288] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425), 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143)
W20260807 20:21:03.224051 24499 leader_election.cc:341] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425): Not found: Tablet not found: 68a7a1520a404ba4bf3d783363b503dc
W20260807 20:21:03.224126 24499 leader_election.cc:341] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143): Not found: Tablet not found: 68a7a1520a404ba4bf3d783363b503dc
I20260807 20:21:03.224143 24499 leader_election.cc:302] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b5e4b7d4d96484a8bcef3f7afd1fb3b; no voters: 06d1e7efbd6f403486c5290743f84ef9, 19caff2bac0a4095ad68bb052590d1e6
I20260807 20:21:03.224217 25049 raft_consensus.cc:2726] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 20:21:03.306715 25050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:03.306505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:37291)
0807 20:21:03.306632 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:03.306672 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
I20260807 20:21:03.437067 25051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:03.436857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:54289)
0807 20:21:03.436991 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:03.437026 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":69,"threads_started":1}
I20260807 20:21:04.219691 25053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:04.219454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:43861)
0807 20:21:04.219598 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:04.219640 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":65,"threads_started":1}
I20260807 20:21:04.307339 25054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:04.307118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:55699)
0807 20:21:04.307257 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:04.307297 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":60,"threads_started":1}
I20260807 20:21:04.437706 25055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:04.437454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:32983)
0807 20:21:04.437586 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:04.437625 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":61,"threads_started":1}
I20260807 20:21:05.220383 25057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:05.220157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:44905)
0807 20:21:05.220284 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:05.220333 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":72,"threads_started":1}
I20260807 20:21:05.307979 25059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:05.307790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:57685)
0807 20:21:05.307900 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:05.307936 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":60,"threads_started":1}
I20260807 20:21:05.438366 25060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:05.438136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:46197)
0807 20:21:05.438278 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:05.438318 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":64,"threads_started":1}
I20260807 20:21:05.890430 25061 raft_consensus.cc:482] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:21:05.890544 25061 raft_consensus.cc:504] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:21:05.890708 25061 leader_election.cc:288] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425), 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143)
W20260807 20:21:05.891111 24499 leader_election.cc:341] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425): Not found: Tablet not found: 68a7a1520a404ba4bf3d783363b503dc
W20260807 20:21:05.891192 24499 leader_election.cc:341] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143): Not found: Tablet not found: 68a7a1520a404ba4bf3d783363b503dc
I20260807 20:21:05.891208 24499 leader_election.cc:302] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b5e4b7d4d96484a8bcef3f7afd1fb3b; no voters: 06d1e7efbd6f403486c5290743f84ef9, 19caff2bac0a4095ad68bb052590d1e6
I20260807 20:21:05.891291 25061 raft_consensus.cc:2726] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 20:21:06.221115 25063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:06.220877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:36201)
0807 20:21:06.221034 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:06.221066 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":97,"threads_started":1}
I20260807 20:21:06.308588 25065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:06.308355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:46849)
0807 20:21:06.308502 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:06.308543 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":63,"threads_started":1}
I20260807 20:21:06.439023 25067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:06.438777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:55497)
0807 20:21:06.438920 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:06.438966 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260807 20:21:07.221889 25068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:07.221595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:50409)
0807 20:21:07.221751 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:07.221798 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":94,"threads_started":1}
I20260807 20:21:07.309253 25069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:07.309030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:48095)
0807 20:21:07.309157 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:07.309203 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":76,"threads_started":1}
I20260807 20:21:07.439639 25071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:07.439436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:34141)
0807 20:21:07.439558 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:07.439596 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":71,"threads_started":1}
I20260807 20:21:08.057512 25073 raft_consensus.cc:482] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:21:08.057617 25073 raft_consensus.cc:504] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:21:08.057803 25073 leader_election.cc:288] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425), 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143)
W20260807 20:21:08.058209 24499 leader_election.cc:341] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425): Not found: Tablet not found: 68a7a1520a404ba4bf3d783363b503dc
W20260807 20:21:08.058296 24499 leader_election.cc:341] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143): Not found: Tablet not found: 68a7a1520a404ba4bf3d783363b503dc
I20260807 20:21:08.058331 24499 leader_election.cc:302] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b5e4b7d4d96484a8bcef3f7afd1fb3b; no voters: 06d1e7efbd6f403486c5290743f84ef9, 19caff2bac0a4095ad68bb052590d1e6
I20260807 20:21:08.058418 25073 raft_consensus.cc:2726] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 20:21:08.222613 25074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:08.222345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:33059)
0807 20:21:08.222513 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:08.222560 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":84,"threads_started":1}
I20260807 20:21:08.309924 25075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:08.309632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:57447)
0807 20:21:08.309800 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:08.309843 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":112,"threads_started":1}
I20260807 20:21:08.440284 25078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:08.440049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:40147)
0807 20:21:08.440198 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:08.440243 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":73,"threads_started":1}
I20260807 20:21:09.223311 25081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:09.223079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:38315)
0807 20:21:09.223218 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:09.223258 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":66,"threads_started":1}
I20260807 20:21:09.310623 25083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:09.310378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:45615)
0807 20:21:09.310532 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:09.310574 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":86,"threads_started":1}
I20260807 20:21:09.440956 25084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:09.440687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:46793)
0807 20:21:09.440870 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:09.440910 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":82,"threads_started":1}
I20260807 20:21:10.224066 25085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:10.223828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:52097)
0807 20:21:10.223977 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:10.224014 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":99,"threads_started":1}
I20260807 20:21:10.311353 25086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:10.311112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:35445)
0807 20:21:10.311259 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:10.311301 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":84,"threads_started":1}
I20260807 20:21:10.441733 25088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:10.441419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:49191)
0807 20:21:10.441612 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:10.441683 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":104,"threads_started":1}
I20260807 20:21:11.224815 25089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:11.224513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:57351)
0807 20:21:11.224688 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:11.224761 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":89,"threads_started":1}
I20260807 20:21:11.312028 25090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:11.311811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:40683)
0807 20:21:11.311940 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:11.311979 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":72,"threads_started":1}
I20260807 20:21:11.442375 25092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:11.442150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:50845)
0807 20:21:11.442279 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:11.442318 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":68,"threads_started":1}
I20260807 20:21:12.225571 25093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:12.225308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:38071)
0807 20:21:12.225462 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:12.225515 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":67,"threads_started":1}
I20260807 20:21:12.312741 25095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:12.312525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:34297)
0807 20:21:12.312654 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:12.312692 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":64,"threads_started":1}
I20260807 20:21:12.443059 25096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:12.442818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:58091)
0807 20:21:12.442969 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:12.443010 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":66,"threads_started":1}
I20260807 20:21:12.660006 25097 raft_consensus.cc:482] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:21:12.660109 25097 raft_consensus.cc:504] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19caff2bac0a4095ad68bb052590d1e6" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 33425 } } peers { permanent_uuid: "06d1e7efbd6f403486c5290743f84ef9" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42143 } } peers { permanent_uuid: "9b5e4b7d4d96484a8bcef3f7afd1fb3b" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 38087 } }
I20260807 20:21:12.660239 25097 leader_election.cc:288] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425), 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143)
W20260807 20:21:12.660666 24499 leader_election.cc:341] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 06d1e7efbd6f403486c5290743f84ef9 (127.30.35.195:42143): Not found: Tablet not found: 68a7a1520a404ba4bf3d783363b503dc
W20260807 20:21:12.660748 24499 leader_election.cc:341] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 19caff2bac0a4095ad68bb052590d1e6 (127.30.35.194:33425): Not found: Tablet not found: 68a7a1520a404ba4bf3d783363b503dc
I20260807 20:21:12.660816 24499 leader_election.cc:302] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9b5e4b7d4d96484a8bcef3f7afd1fb3b; no voters: 06d1e7efbd6f403486c5290743f84ef9, 19caff2bac0a4095ad68bb052590d1e6
I20260807 20:21:12.660905 25097 raft_consensus.cc:2726] T 68a7a1520a404ba4bf3d783363b503dc P 9b5e4b7d4d96484a8bcef3f7afd1fb3b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 20:21:13.226326 25098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:13.226101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:50871)
0807 20:21:13.226227 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:13.226266 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":66,"threads_started":1}
I20260807 20:21:13.313397 25099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:13.313173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:50185)
0807 20:21:13.313311 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:13.313350 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":63,"threads_started":1}
I20260807 20:21:13.443711 25100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:13.443472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:53385)
0807 20:21:13.443609 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:13.443648 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":91,"threads_started":1}
I20260807 20:21:14.227026 25101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:14.226769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:45111)
0807 20:21:14.226935 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:14.226976 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":86,"threads_started":1}
I20260807 20:21:14.314225 25102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:14.313947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:45407)
0807 20:21:14.314116 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:14.314162 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":83,"threads_started":1}
I20260807 20:21:14.444492 25105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:14.444231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:41023)
0807 20:21:14.444377 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:14.444424 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":70,"threads_started":1}
I20260807 20:21:15.227789 25109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:15.227548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.193:47241)
0807 20:21:15.227700 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:15.227740 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":80,"threads_started":1}
I20260807 20:21:15.315060 25110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:15.314802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.194:41485)
0807 20:21:15.314971 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:15.315011 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":90,"threads_started":1}
I20260807 20:21:15.444914 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 24423
I20260807 20:21:15.447809 25112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:15.445037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:41985 (local address 127.30.35.195:58387)
0807 20:21:15.447679 (+ 2642us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:15.447748 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.254:41985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2617,"thread_start_us":64,"threads_started":1}
I20260807 20:21:15.457978 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 24664
I20260807 20:21:15.470216 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 24853
2026-08-07T20:21:15Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58633 ms)
[----------] 30 tests from SecurityITest (231299 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:15 dist-test-slave-t7g5 krb5kdc[25115](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:15 dist-test-slave-t7g5 krb5kdc[25115](info): set up 2 sockets
Aug 07 20:21:15 dist-test-slave-t7g5 krb5kdc[25115](info): commencing operation
krb5kdc: starting...
W20260807 20:21:16.636001 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:16 dist-test-slave-t7g5 krb5kdc[25115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:21:16.758201 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:34861
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:34861
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:16.839457 25132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:16.839670 25132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:16.839700 25132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:16.840824 25132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:16.840867 25132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:16.840885 25132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:16.840901 25132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:16.840916 25132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:16.842379 25132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:34861
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:34861
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:16.842622 25132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:16.842825 25132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:16.847790 25140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:16.847834 25142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:16.847806 25139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:16.847796 25132 server_base.cc:1034] running on GCE node
I20260807 20:21:16.848241 25132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:16.848526 25132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:16.849707 25132 hybrid_clock.cc:648] HybridClock initialized: now 1786134076849691 us; error 32 us; skew 500 ppm
Aug 07 20:21:16 dist-test-slave-t7g5 krb5kdc[25115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134076, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:16.855139 25132 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:21:16.855594 25132 webserver.cc:460] Webserver started at http://127.30.35.254:45477/ using document root <none> and password file <none>
I20260807 20:21:16.855810 25132 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:16.855868 25132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:16.855995 25132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:16.857028 25132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "27b4bfccdd314b319f7903436d9c9069"
format_stamp: "Formatted at 2026-08-07 20:21:16 on dist-test-slave-t7g5"
server_key: "e283fcf5dab6a1049a3c879816dd75a0"
server_key_iv: "ce1a77b9b16dd229a1bd73969a60efeb"
server_key_version: "encryptionkey@0"
I20260807 20:21:16.857393 25132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "27b4bfccdd314b319f7903436d9c9069"
format_stamp: "Formatted at 2026-08-07 20:21:16 on dist-test-slave-t7g5"
server_key: "e283fcf5dab6a1049a3c879816dd75a0"
server_key_iv: "ce1a77b9b16dd229a1bd73969a60efeb"
server_key_version: "encryptionkey@0"
I20260807 20:21:16.858711 25132 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:21:16.859407 25155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:16.859555 25132 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:16.859628 25132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "27b4bfccdd314b319f7903436d9c9069"
format_stamp: "Formatted at 2026-08-07 20:21:16 on dist-test-slave-t7g5"
server_key: "e283fcf5dab6a1049a3c879816dd75a0"
server_key_iv: "ce1a77b9b16dd229a1bd73969a60efeb"
server_key_version: "encryptionkey@0"
I20260807 20:21:16.859694 25132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:16.872829 25132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:16.874548 25132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:16.874679 25132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:16.878505 25132 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:34861
I20260807 20:21:16.878537 25226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:34861 every 8 connection(s)
I20260807 20:21:16.878851 25132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:16.879662 25228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:16.881935 25228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069: Bootstrap starting.
I20260807 20:21:16.882485 25228 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:16.882759 25228 log.cc:824] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:16.882782 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 25132
I20260807 20:21:16.882853 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:16.883050 30863 external_mini_cluster.cc:1428] Setting key c8a9d6dff09c8b2eb016adb23cf75f8a
I20260807 20:21:16.883538 25228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069: No bootstrap required, opened a new log
I20260807 20:21:16.885383 25228 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27b4bfccdd314b319f7903436d9c9069" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34861 } }
I20260807 20:21:16.885557 25228 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:16.885596 25228 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27b4bfccdd314b319f7903436d9c9069, State: Initialized, Role: FOLLOWER
I20260807 20:21:16.885771 25228 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27b4bfccdd314b319f7903436d9c9069" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34861 } }
I20260807 20:21:16.885849 25228 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:16.885871 25228 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:16.885906 25228 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:16.886937 25228 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27b4bfccdd314b319f7903436d9c9069" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34861 } }
I20260807 20:21:16.887056 25228 leader_election.cc:302] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27b4bfccdd314b319f7903436d9c9069; no voters:
I20260807 20:21:16.887208 25228 leader_election.cc:288] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:16.887246 25237 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:16.887423 25237 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [term 1 LEADER]: Becoming Leader. State: Replica: 27b4bfccdd314b319f7903436d9c9069, State: Running, Role: LEADER
I20260807 20:21:16.887439 25228 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:16.887580 25237 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27b4bfccdd314b319f7903436d9c9069" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34861 } }
I20260807 20:21:16.887923 25237 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27b4bfccdd314b319f7903436d9c9069. Latest consensus state: current_term: 1 leader_uuid: "27b4bfccdd314b319f7903436d9c9069" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27b4bfccdd314b319f7903436d9c9069" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34861 } } }
I20260807 20:21:16.887992 25237 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:16.889087 25239 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27b4bfccdd314b319f7903436d9c9069" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27b4bfccdd314b319f7903436d9c9069" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34861 } } }
I20260807 20:21:16.889690 25239 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069 [sys.catalog]: This master's current role is: LEADER
W20260807 20:21:16.889302 25262 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:21:16.889755 25262 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:21:16.889819 25251 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:16.890051 25251 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 20:21:16 dist-test-slave-t7g5 krb5kdc[25115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134076, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:16.891923 25251 catalog_manager.cc:1347] Generated new cluster ID: 78b1b39bb7ae4669a9e8c56cd38943b9
I20260807 20:21:16.891973 25251 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:16.895586 25236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:16.883533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49878 (local address 127.30.35.254:34861)
0807 20:21:16.883716 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:16.883727 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:16.883763 (+ 36us) server_negotiation.cc:407] Connection header received
0807 20:21:16.885350 (+ 1587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:16.885359 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:16.885426 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:16.885589 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:16.886280 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:16.887739 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:16.888764 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:16.889351 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:16.889449 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:16.891924 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:16.891928 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:16.891929 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:16.891939 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:16.893932 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:16.894307 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:16.894310 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:16.894310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:16.894460 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:16.894637 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:16.894638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:16.894639 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:16.894956 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:16.895136 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:16.895211 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 20:21:16.895361 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":77,"threads_started":1}
I20260807 20:21:16.910204 25251 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:16.910763 25251 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:16.916925 25251 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069: Generated new TSK 0
I20260807 20:21:16.917106 25251 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:21:16.943691 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34861
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:17.024928 25268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:17.025141 25268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:17.025162 25268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:17.026288 25268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:17.026330 25268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:17.026355 25268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:21:17.028299 25268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:17.028555 25268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:17.028785 25268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:17.033509 25278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:17.033524 25281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:17.033548 25277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:17.033607 25268 server_base.cc:1034] running on GCE node
I20260807 20:21:17.033924 25268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:17.034147 25268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:17.035320 25268 hybrid_clock.cc:648] HybridClock initialized: now 1786134077035299 us; error 31 us; skew 500 ppm
Aug 07 20:21:17 dist-test-slave-t7g5 krb5kdc[25115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134077, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:17.037958 25268 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:21:17.038419 25268 webserver.cc:460] Webserver started at http://127.30.35.193:45579/ using document root <none> and password file <none>
I20260807 20:21:17.038641 25268 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:17.038691 25268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:17.038825 25268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:17.039872 25268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "7e2abc6ebedd4c338193e818071099bb"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "f22593b4a72fbf9ffd9359cd43ddef3f"
server_key_iv: "1fb0112f82dc5511b3bbdee13cb8f9cc"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.040215 25268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "7e2abc6ebedd4c338193e818071099bb"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "f22593b4a72fbf9ffd9359cd43ddef3f"
server_key_iv: "1fb0112f82dc5511b3bbdee13cb8f9cc"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.041466 25268 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260807 20:21:17.042248 25289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.042402 25268 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.042490 25268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "7e2abc6ebedd4c338193e818071099bb"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "f22593b4a72fbf9ffd9359cd43ddef3f"
server_key_iv: "1fb0112f82dc5511b3bbdee13cb8f9cc"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.042560 25268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:17.064687 25268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:17.066985 25268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:17.067135 25268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:17.067369 25268 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:17.067673 25268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:17.067708 25268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.067737 25268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:17.067770 25268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.073809 25268 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:35731
I20260807 20:21:17.073873 25459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:35731 every 8 connection(s)
I20260807 20:21:17.074184 25268 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:21:17.079063 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 25268
I20260807 20:21:17.079183 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:21:17.079386 30863 external_mini_cluster.cc:1428] Setting key d80fb99e8d0595b5d7b973e769f7c515
Aug 07 20:21:17 dist-test-slave-t7g5 krb5kdc[25115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134077, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:17.083801 25236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.074875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:49573 (local address 127.30.35.254:34861)
0807 20:21:17.074942 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:17.074944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:17.075120 (+ 176us) server_negotiation.cc:407] Connection header received
0807 20:21:17.075624 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:17.075625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:17.075639 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:17.075690 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:17.076654 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.077192 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.078234 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.078459 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.078531 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.080814 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:17.080816 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:17.080816 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:17.080825 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:17.082377 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:17.082770 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:17.082772 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:17.082773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:17.082845 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:17.083116 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:17.083117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:17.083118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:17.083237 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:17.083295 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:17.083616 (+ 321us) server_negotiation.cc:299] Negotiation successful
0807 20:21:17.083707 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260807 20:21:17.083967 25465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.074862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34861 (local address 127.30.35.193:49573)
0807 20:21:17.075013 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:17.075050 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:17.075539 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:17.075761 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:17.075764 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:17.076330 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:17.076544 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.076549 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.077264 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.077264 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.078129 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.078132 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.078535 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.078536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.078635 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.079125 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:17.079134 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:17.080704 (+ 1570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:17.082475 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:17.082483 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:17.082484 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:17.082700 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:17.082919 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:17.082919 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:17.082920 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:17.083055 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:17.083296 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:17.083303 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:17.083471 (+ 168us) client_negotiation.cc:769] Sending connection context
0807 20:21:17.083581 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 20:21:17.083739 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
I20260807 20:21:17.084604 25460 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34861
I20260807 20:21:17.084712 25460 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:17.084898 25460 heartbeater.cc:511] Master 127.30.35.254:34861 requested a full tablet report, sending...
I20260807 20:21:17.085510 25180 ts_manager.cc:194] Registered new tserver with Master: 7e2abc6ebedd4c338193e818071099bb (127.30.35.193:35731)
I20260807 20:21:17.086404 25180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:49573
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:21:17.105973 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34861
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:17.186702 25468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:17.186892 25468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:17.186914 25468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:17.188066 25468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:17.188108 25468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:17.188134 25468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:21:17.189641 25468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:17.189851 25468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:17.190012 25468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:17.194650 25478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:17.194661 25477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:17.194804 25468 server_base.cc:1034] running on GCE node
W20260807 20:21:17.194727 25480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:17.195122 25468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:17.195351 25468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:17.196513 25468 hybrid_clock.cc:648] HybridClock initialized: now 1786134077196500 us; error 37 us; skew 500 ppm
Aug 07 20:21:17 dist-test-slave-t7g5 krb5kdc[25115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134077, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:17.199079 25468 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:21:17.199501 25468 webserver.cc:460] Webserver started at http://127.30.35.194:35143/ using document root <none> and password file <none>
I20260807 20:21:17.199712 25468 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:17.199759 25468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:17.199884 25468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:17.200927 25468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "4f1883ea8acc44b2a83ea871751c5aa8"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "f459c1bede88690eacbbae0f6ce55130"
server_key_iv: "e5a4a72f95bc66d9d5988bc6af341a2b"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.201248 25468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "4f1883ea8acc44b2a83ea871751c5aa8"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "f459c1bede88690eacbbae0f6ce55130"
server_key_iv: "e5a4a72f95bc66d9d5988bc6af341a2b"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.202538 25468 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 20:21:17.203161 25493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.203311 25468 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.203429 25468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "4f1883ea8acc44b2a83ea871751c5aa8"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "f459c1bede88690eacbbae0f6ce55130"
server_key_iv: "e5a4a72f95bc66d9d5988bc6af341a2b"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.203488 25468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:17.230573 25468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:17.232788 25468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:17.232937 25468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:17.233172 25468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:17.233484 25468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:17.233520 25468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.233549 25468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:17.233572 25468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.239005 25468 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:40151
I20260807 20:21:17.239087 25658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:40151 every 8 connection(s)
I20260807 20:21:17.239365 25468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:21:17.241184 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 25468
I20260807 20:21:17.241287 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:21:17.241477 30863 external_mini_cluster.cc:1428] Setting key de73eb94f4a243248691842546cf7b1a
Aug 07 20:21:17 dist-test-slave-t7g5 krb5kdc[25115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134077, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:17.249032 25236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.240086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:50451 (local address 127.30.35.254:34861)
0807 20:21:17.240163 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:17.240166 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:17.240333 (+ 167us) server_negotiation.cc:407] Connection header received
0807 20:21:17.240789 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:17.240790 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:17.240800 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:17.240855 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:17.241911 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.242620 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.243610 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.243893 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.243958 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.246269 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:17.246301 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:17.246302 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:17.246315 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:17.247642 (+ 1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:17.248103 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:17.248104 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:17.248104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:17.248147 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:17.248400 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:17.248401 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:17.248401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:17.248491 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:17.248533 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:17.248880 (+ 347us) server_negotiation.cc:299] Negotiation successful
0807 20:21:17.248964 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 20:21:17.249222 25661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.240057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34861 (local address 127.30.35.194:50451)
0807 20:21:17.240218 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:17.240254 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:17.240710 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:17.240917 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:17.240920 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:17.241527 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:17.241838 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.241845 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.242712 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.242713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.243531 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.243533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.243978 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.243979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.244106 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.244567 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:17.244575 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:17.246183 (+ 1608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:17.247721 (+ 1538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:17.247729 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:17.247731 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:17.248034 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:17.248199 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:17.248200 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:17.248200 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:17.248346 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:17.248544 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:17.248550 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:17.248712 (+ 162us) client_negotiation.cc:769] Sending connection context
0807 20:21:17.248826 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 20:21:17.248997 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":85,"threads_started":1}
I20260807 20:21:17.249706 25659 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34861
I20260807 20:21:17.249823 25659 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:17.250015 25659 heartbeater.cc:511] Master 127.30.35.254:34861 requested a full tablet report, sending...
I20260807 20:21:17.250452 25180 ts_manager.cc:194] Registered new tserver with Master: 4f1883ea8acc44b2a83ea871751c5aa8 (127.30.35.194:40151)
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
I20260807 20:21:17.250867 25180 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:50451
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:21:17.267827 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34861
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:17.349591 25666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:17.349818 25666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:17.349840 25666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:17.350951 25666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:17.350986 25666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:17.351011 25666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:21:17.352460 25666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34861
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:17.352670 25666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:17.352862 25666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:17.357743 25674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:17.357919 25666 server_base.cc:1034] running on GCE node
W20260807 20:21:17.357753 25675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:17.357786 25677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:17.358259 25666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:17.358505 25666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:17.359653 25666 hybrid_clock.cc:648] HybridClock initialized: now 1786134077359639 us; error 29 us; skew 500 ppm
Aug 07 20:21:17 dist-test-slave-t7g5 krb5kdc[25115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134077, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:17.362039 25666 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:21:17.362463 25666 webserver.cc:460] Webserver started at http://127.30.35.195:40415/ using document root <none> and password file <none>
I20260807 20:21:17.362672 25666 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:17.362720 25666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:17.362843 25666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:17.363870 25666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "a06f2c8369bf4019b957923a4249a3a2"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "e8147cd8ddec0993b8ff063c2bd1b32b"
server_key_iv: "fc1227cf1c02fc4dfabde41aa74dbef6"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.364212 25666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "a06f2c8369bf4019b957923a4249a3a2"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "e8147cd8ddec0993b8ff063c2bd1b32b"
server_key_iv: "fc1227cf1c02fc4dfabde41aa74dbef6"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.366291 25666 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260807 20:21:17.367055 25693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.367230 25666 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:17.367323 25666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "a06f2c8369bf4019b957923a4249a3a2"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "e8147cd8ddec0993b8ff063c2bd1b32b"
server_key_iv: "fc1227cf1c02fc4dfabde41aa74dbef6"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.367403 25666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:17.384863 25666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:17.386693 25666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:17.386857 25666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:17.387089 25666 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:17.387441 25666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:17.387493 25666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.387522 25666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:17.387548 25666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.393478 25666 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:45729
I20260807 20:21:17.393543 25855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:45729 every 8 connection(s)
I20260807 20:21:17.393864 25666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
Aug 07 20:21:17 dist-test-slave-t7g5 krb5kdc[25115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134077, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:17.402446 25236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.394533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:47455 (local address 127.30.35.254:34861)
0807 20:21:17.394585 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:17.394587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:17.394777 (+ 190us) server_negotiation.cc:407] Connection header received
0807 20:21:17.395279 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:17.395280 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:17.395293 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:17.395346 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:17.396306 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.396804 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.397833 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.398040 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.398097 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.400101 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:17.400103 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:17.400104 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:17.400111 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:17.401167 (+ 1056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:17.401530 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:17.401531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:17.401531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:17.401586 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:17.401855 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:17.401856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:17.401856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:17.401967 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:17.402024 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:17.402273 (+ 249us) server_negotiation.cc:299] Negotiation successful
0807 20:21:17.402354 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 20:21:17.402622 25858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.394522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34861 (local address 127.30.35.195:47455)
0807 20:21:17.394664 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:17.394700 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:17.395182 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:17.395432 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:17.395436 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:17.396010 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:17.396208 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.396213 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.396901 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.396902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.397759 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.397761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.398109 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.398110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.398240 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.398700 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:17.398709 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:17.400013 (+ 1304us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:17.401239 (+ 1226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:17.401246 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:17.401249 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:17.401462 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:17.401639 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:17.401640 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:17.401640 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:17.401788 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:17.402023 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:17.402030 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:17.402158 (+ 128us) client_negotiation.cc:769] Sending connection context
0807 20:21:17.402247 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 20:21:17.402410 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":73,"threads_started":1}
I20260807 20:21:17.403131 25856 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34861
I20260807 20:21:17.403211 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 25666
I20260807 20:21:17.403245 25856 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:17.403312 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:21:17.403450 25856 heartbeater.cc:511] Master 127.30.35.254:34861 requested a full tablet report, sending...
I20260807 20:21:17.403487 30863 external_mini_cluster.cc:1428] Setting key c23e56f2f7c623b992d52c1601fb9901
I20260807 20:21:17.403882 25179 ts_manager.cc:194] Registered new tserver with Master: a06f2c8369bf4019b957923a4249a3a2 (127.30.35.195:45729)
I20260807 20:21:17.404291 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:21:17.404352 25179 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:47455
I20260807 20:21:17.410797 25236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.405563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49888 (local address 127.30.35.254:34861)
0807 20:21:17.405609 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:17.405610 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:17.405744 (+ 134us) server_negotiation.cc:407] Connection header received
0807 20:21:17.405803 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:17.405804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:17.405813 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:17.405854 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:17.406377 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.406826 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.407516 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.407710 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.407763 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.408769 (+ 1006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:17.408770 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:17.408771 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:17.408777 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:17.409787 (+ 1010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:17.410082 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:17.410083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:17.410083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:17.410139 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:17.410291 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:17.410292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:17.410293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:17.410438 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:17.410528 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:17.410639 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 20:21:17.410712 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 20:21:17.412155 25179 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49888:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:21:17.413589 25179 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:21:17.419858 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.415574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:45729 (local address 127.0.0.1:50878)
0807 20:21:17.416002 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:17.416010 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:17.416048 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:17.416549 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:17.416550 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:17.416553 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:17.416612 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.416614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.417922 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.417923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.418978 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.418980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.419576 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.419577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.419652 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.419665 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 20:21:17.419729 (+ 64us) client_negotiation.cc:240] Negotiation successful
0807 20:21:17.419778 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"mutex_wait_us":36,"thread_start_us":78,"threads_started":1}
I20260807 20:21:17.419939 25868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.415571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:35731 (local address 127.0.0.1:32868)
0807 20:21:17.415803 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:17.415842 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:17.415913 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:17.416515 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:17.416519 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:17.416521 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:17.416588 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.416590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.417548 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.417549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.418769 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.418772 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.419679 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.419680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.419746 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.419749 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:17.419794 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:21:17.419827 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":86,"threads_started":1}
I20260807 20:21:17.419934 25874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.415922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32868 (local address 127.30.35.193:35731)
0807 20:21:17.416321 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:17.416325 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:17.416335 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:21:17.416386 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:17.416388 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:17.416404 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:17.416665 (+ 261us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:17.416734 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.417459 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.418859 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.419568 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.419676 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.419737 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:17.419808 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 20:21:17.419855 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":236,"threads_started":1}
I20260807 20:21:17.420127 25873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.415997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51154 (local address 127.30.35.194:40151)
0807 20:21:17.416181 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:17.416185 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:17.416221 (+ 36us) server_negotiation.cc:407] Connection header received
0807 20:21:17.416484 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:17.416487 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:17.416503 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:17.416600 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:17.416675 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.417842 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.418930 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.419617 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.419916 (+ 299us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.419985 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:17.420012 (+ 27us) server_negotiation.cc:299] Negotiation successful
0807 20:21:17.420053 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":78,"threads_started":1}
I20260807 20:21:17.420145 25870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.415787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:40151 (local address 127.0.0.1:51154)
0807 20:21:17.416136 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:17.416144 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:17.416180 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:17.416599 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:17.416599 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:17.416601 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:17.416632 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.416634 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.417960 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.417961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.418839 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.418843 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.419705 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.419706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.419767 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.419771 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:21:17.419801 (+ 30us) client_negotiation.cc:240] Negotiation successful
0807 20:21:17.419843 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":60,"threads_started":1}
I20260807 20:21:17.420645 25363 tablet_service.cc:1467] Processing CreateTablet for tablet 7d8e34b3057a408995ac9c0df2bd22a8 (DEFAULT_TABLE table=test-table [id=af6ae5432a5440ab9845ae3cf22bfa53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:17.420855 25556 tablet_service.cc:1467] Processing CreateTablet for tablet 7d8e34b3057a408995ac9c0df2bd22a8 (DEFAULT_TABLE table=test-table [id=af6ae5432a5440ab9845ae3cf22bfa53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:17.420998 25363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d8e34b3057a408995ac9c0df2bd22a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:17.421156 25556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d8e34b3057a408995ac9c0df2bd22a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:17.421870 25872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.415730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50878 (local address 127.30.35.195:45729)
0807 20:21:17.416319 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:17.416324 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:17.416333 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:21:17.416408 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:17.416410 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:17.416426 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:17.416680 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:17.416740 (+ 60us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.417808 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.419045 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.419501 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.419564 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.419623 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:17.421743 (+ 2120us) server_negotiation.cc:299] Negotiation successful
0807 20:21:17.421786 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":274,"threads_started":1}
I20260807 20:21:17.423727 25877 tablet_bootstrap.cc:492] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8: Bootstrap starting.
I20260807 20:21:17.424094 25766 tablet_service.cc:1467] Processing CreateTablet for tablet 7d8e34b3057a408995ac9c0df2bd22a8 (DEFAULT_TABLE table=test-table [id=af6ae5432a5440ab9845ae3cf22bfa53]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:17.424326 25877 tablet_bootstrap.cc:654] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:17.424366 25766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d8e34b3057a408995ac9c0df2bd22a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:17.424774 25877 log.cc:824] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:17.425421 25877 tablet_bootstrap.cc:492] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8: No bootstrap required, opened a new log
I20260807 20:21:17.425479 25877 ts_tablet_manager.cc:1397] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:21:17.425817 25875 tablet_bootstrap.cc:492] T 7d8e34b3057a408995ac9c0df2bd22a8 P 7e2abc6ebedd4c338193e818071099bb: Bootstrap starting.
I20260807 20:21:17.426476 25875 tablet_bootstrap.cc:654] T 7d8e34b3057a408995ac9c0df2bd22a8 P 7e2abc6ebedd4c338193e818071099bb: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:17.426939 25877 raft_consensus.cc:348] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2abc6ebedd4c338193e818071099bb" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 35731 } } peers { permanent_uuid: "a06f2c8369bf4019b957923a4249a3a2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 45729 } } peers { permanent_uuid: "4f1883ea8acc44b2a83ea871751c5aa8" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40151 } }
I20260807 20:21:17.427078 25877 raft_consensus.cc:374] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:17.427064 25875 log.cc:824] T 7d8e34b3057a408995ac9c0df2bd22a8 P 7e2abc6ebedd4c338193e818071099bb: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:17.427109 25877 raft_consensus.cc:729] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f1883ea8acc44b2a83ea871751c5aa8, State: Initialized, Role: FOLLOWER
I20260807 20:21:17.427219 25877 consensus_queue.cc:260] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2abc6ebedd4c338193e818071099bb" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 35731 } } peers { permanent_uuid: "a06f2c8369bf4019b957923a4249a3a2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 45729 } } peers { permanent_uuid: "4f1883ea8acc44b2a83ea871751c5aa8" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40151 } }
I20260807 20:21:17.427433 25880 tablet_bootstrap.cc:492] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2: Bootstrap starting.
I20260807 20:21:17.427482 25877 ts_tablet_manager.cc:1428] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:21:17.427598 25659 heartbeater.cc:503] Master 127.30.35.254:34861 was elected leader, sending a full tablet report...
I20260807 20:21:17.427964 25875 tablet_bootstrap.cc:492] T 7d8e34b3057a408995ac9c0df2bd22a8 P 7e2abc6ebedd4c338193e818071099bb: No bootstrap required, opened a new log
I20260807 20:21:17.428032 25875 ts_tablet_manager.cc:1397] T 7d8e34b3057a408995ac9c0df2bd22a8 P 7e2abc6ebedd4c338193e818071099bb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:21:17.428360 25880 tablet_bootstrap.cc:654] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:17.428763 25880 log.cc:824] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:17.429447 25880 tablet_bootstrap.cc:492] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2: No bootstrap required, opened a new log
I20260807 20:21:17.429520 25880 ts_tablet_manager.cc:1397] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:21:17.429764 25875 raft_consensus.cc:348] T 7d8e34b3057a408995ac9c0df2bd22a8 P 7e2abc6ebedd4c338193e818071099bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2abc6ebedd4c338193e818071099bb" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 35731 } } peers { permanent_uuid: "a06f2c8369bf4019b957923a4249a3a2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 45729 } } peers { permanent_uuid: "4f1883ea8acc44b2a83ea871751c5aa8" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40151 } }
I20260807 20:21:17.429943 25875 raft_consensus.cc:374] T 7d8e34b3057a408995ac9c0df2bd22a8 P 7e2abc6ebedd4c338193e818071099bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:17.429984 25875 raft_consensus.cc:729] T 7d8e34b3057a408995ac9c0df2bd22a8 P 7e2abc6ebedd4c338193e818071099bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e2abc6ebedd4c338193e818071099bb, State: Initialized, Role: FOLLOWER
I20260807 20:21:17.430092 25875 consensus_queue.cc:260] T 7d8e34b3057a408995ac9c0df2bd22a8 P 7e2abc6ebedd4c338193e818071099bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2abc6ebedd4c338193e818071099bb" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 35731 } } peers { permanent_uuid: "a06f2c8369bf4019b957923a4249a3a2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 45729 } } peers { permanent_uuid: "4f1883ea8acc44b2a83ea871751c5aa8" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40151 } }
I20260807 20:21:17.430361 25875 ts_tablet_manager.cc:1428] T 7d8e34b3057a408995ac9c0df2bd22a8 P 7e2abc6ebedd4c338193e818071099bb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 20:21:17.430472 25460 heartbeater.cc:503] Master 127.30.35.254:34861 was elected leader, sending a full tablet report...
I20260807 20:21:17.431223 25880 raft_consensus.cc:348] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2abc6ebedd4c338193e818071099bb" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 35731 } } peers { permanent_uuid: "a06f2c8369bf4019b957923a4249a3a2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 45729 } } peers { permanent_uuid: "4f1883ea8acc44b2a83ea871751c5aa8" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40151 } }
I20260807 20:21:17.431385 25880 raft_consensus.cc:374] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:17.431430 25880 raft_consensus.cc:729] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a06f2c8369bf4019b957923a4249a3a2, State: Initialized, Role: FOLLOWER
I20260807 20:21:17.431531 25880 consensus_queue.cc:260] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2abc6ebedd4c338193e818071099bb" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 35731 } } peers { permanent_uuid: "a06f2c8369bf4019b957923a4249a3a2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 45729 } } peers { permanent_uuid: "4f1883ea8acc44b2a83ea871751c5aa8" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40151 } }
I20260807 20:21:17.431766 25880 ts_tablet_manager.cc:1428] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 20:21:17.431819 25856 heartbeater.cc:503] Master 127.30.35.254:34861 was elected leader, sending a full tablet report...
W20260807 20:21:17.489962 25660 tablet.cc:2369] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:21:17.512112 25889 raft_consensus.cc:482] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:21:17.512257 25889 raft_consensus.cc:504] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2abc6ebedd4c338193e818071099bb" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 35731 } } peers { permanent_uuid: "a06f2c8369bf4019b957923a4249a3a2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 45729 } } peers { permanent_uuid: "4f1883ea8acc44b2a83ea871751c5aa8" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40151 } }
I20260807 20:21:17.512581 25889 leader_election.cc:288] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e2abc6ebedd4c338193e818071099bb (127.30.35.193:35731), 4f1883ea8acc44b2a83ea871751c5aa8 (127.30.35.194:40151)
I20260807 20:21:17.515329 25873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.512847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:34249 (local address 127.30.35.194:40151)
0807 20:21:17.512898 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:17.512900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:17.512911 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:21:17.512990 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:17.512991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:17.513001 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:17.513050 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:17.513200 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.513703 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.514629 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.515014 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.515078 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.515088 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:17.515226 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 20:21:17.515263 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 20:21:17.515331 25858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.512761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:40151 (local address 127.30.35.195:34249)
0807 20:21:17.512846 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:17.512858 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:17.512908 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:17.513063 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:17.513064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:17.513066 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:17.513141 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.513143 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.513782 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.513783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.514543 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.514546 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.515091 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.515092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.515163 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.515166 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:17.515213 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 20:21:17.515253 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61,"mutex_wait_us":32}
I20260807 20:21:17.515390 25874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.512886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:36155 (local address 127.30.35.193:35731)
0807 20:21:17.512932 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:17.512934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:17.513064 (+ 130us) server_negotiation.cc:407] Connection header received
0807 20:21:17.513112 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:17.513113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:17.513123 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:17.513168 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:17.513310 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.513800 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.514710 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.515084 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.515149 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.515158 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:17.515290 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 20:21:17.515325 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 20:21:17.515439 25890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.512780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:35731 (local address 127.30.35.195:36155)
0807 20:21:17.512992 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:17.513000 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:17.513057 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:17.513179 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:17.513179 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:17.513181 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:17.513249 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.513251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.513877 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.513878 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.514624 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.514626 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.515164 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.515165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.515229 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.515232 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:17.515277 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:21:17.515316 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":117,"threads_started":1}
I20260807 20:21:17.515769 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8e34b3057a408995ac9c0df2bd22a8" candidate_uuid: "a06f2c8369bf4019b957923a4249a3a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1883ea8acc44b2a83ea871751c5aa8" is_pre_election: true
I20260807 20:21:17.515775 25391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8e34b3057a408995ac9c0df2bd22a8" candidate_uuid: "a06f2c8369bf4019b957923a4249a3a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2abc6ebedd4c338193e818071099bb" is_pre_election: true
I20260807 20:21:17.515925 25590 raft_consensus.cc:2454] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a06f2c8369bf4019b957923a4249a3a2 in term 0.
I20260807 20:21:17.515924 25391 raft_consensus.cc:2454] T 7d8e34b3057a408995ac9c0df2bd22a8 P 7e2abc6ebedd4c338193e818071099bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a06f2c8369bf4019b957923a4249a3a2 in term 0.
I20260807 20:21:17.516144 25694 leader_election.cc:302] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f1883ea8acc44b2a83ea871751c5aa8, a06f2c8369bf4019b957923a4249a3a2; no voters:
I20260807 20:21:17.516283 25889 raft_consensus.cc:2781] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:21:17.516345 25889 raft_consensus.cc:482] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:21:17.516359 25889 raft_consensus.cc:3037] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:17.517043 25889 raft_consensus.cc:504] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2abc6ebedd4c338193e818071099bb" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 35731 } } peers { permanent_uuid: "a06f2c8369bf4019b957923a4249a3a2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 45729 } } peers { permanent_uuid: "4f1883ea8acc44b2a83ea871751c5aa8" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40151 } }
I20260807 20:21:17.517165 25889 leader_election.cc:288] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [CANDIDATE]: Term 1 election: Requested vote from peers 7e2abc6ebedd4c338193e818071099bb (127.30.35.193:35731), 4f1883ea8acc44b2a83ea871751c5aa8 (127.30.35.194:40151)
I20260807 20:21:17.517333 25590 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8e34b3057a408995ac9c0df2bd22a8" candidate_uuid: "a06f2c8369bf4019b957923a4249a3a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f1883ea8acc44b2a83ea871751c5aa8"
I20260807 20:21:17.517343 25391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8e34b3057a408995ac9c0df2bd22a8" candidate_uuid: "a06f2c8369bf4019b957923a4249a3a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e2abc6ebedd4c338193e818071099bb"
I20260807 20:21:17.517423 25590 raft_consensus.cc:3037] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:17.517423 25391 raft_consensus.cc:3037] T 7d8e34b3057a408995ac9c0df2bd22a8 P 7e2abc6ebedd4c338193e818071099bb [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:17.518362 25391 raft_consensus.cc:2454] T 7d8e34b3057a408995ac9c0df2bd22a8 P 7e2abc6ebedd4c338193e818071099bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a06f2c8369bf4019b957923a4249a3a2 in term 1.
I20260807 20:21:17.518356 25590 raft_consensus.cc:2454] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a06f2c8369bf4019b957923a4249a3a2 in term 1.
I20260807 20:21:17.518532 25695 leader_election.cc:302] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e2abc6ebedd4c338193e818071099bb, a06f2c8369bf4019b957923a4249a3a2; no voters:
I20260807 20:21:17.518644 25889 raft_consensus.cc:2781] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:17.518823 25889 raft_consensus.cc:686] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [term 1 LEADER]: Becoming Leader. State: Replica: a06f2c8369bf4019b957923a4249a3a2, State: Running, Role: LEADER
I20260807 20:21:17.518923 25889 consensus_queue.cc:237] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2abc6ebedd4c338193e818071099bb" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 35731 } } peers { permanent_uuid: "a06f2c8369bf4019b957923a4249a3a2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 45729 } } peers { permanent_uuid: "4f1883ea8acc44b2a83ea871751c5aa8" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40151 } }
I20260807 20:21:17.519758 25179 catalog_manager.cc:5495] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to a06f2c8369bf4019b957923a4249a3a2 (127.30.35.195). New cstate: current_term: 1 leader_uuid: "a06f2c8369bf4019b957923a4249a3a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e2abc6ebedd4c338193e818071099bb" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 35731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a06f2c8369bf4019b957923a4249a3a2" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 45729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f1883ea8acc44b2a83ea871751c5aa8" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40151 } health_report { overall_health: UNKNOWN } } }
I20260807 20:21:17.533785 25872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.531497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50890 (local address 127.30.35.195:45729)
0807 20:21:17.531545 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:17.531547 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:17.531557 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:21:17.531641 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:17.531642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:17.531659 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:17.531717 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:17.531845 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.532312 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.533059 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.533244 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.533305 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.533442 (+ 137us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:17.533546 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:17.533615 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:17.533682 (+ 67us) server_negotiation.cc:299] Negotiation successful
0807 20:21:17.533704 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 20:21:17.535514 25391 raft_consensus.cc:1261] T 7d8e34b3057a408995ac9c0df2bd22a8 P 7e2abc6ebedd4c338193e818071099bb [term 1 FOLLOWER]: Refusing update from remote peer a06f2c8369bf4019b957923a4249a3a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:17.535770 25590 raft_consensus.cc:1261] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8 [term 1 FOLLOWER]: Refusing update from remote peer a06f2c8369bf4019b957923a4249a3a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:17.535953 25889 consensus_queue.cc:1035] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e2abc6ebedd4c338193e818071099bb" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 35731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:17.536077 25891 consensus_queue.cc:1035] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f1883ea8acc44b2a83ea871751c5aa8" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:17.540746 25180 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:21:17.540840 25180 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:21:17.541558 25180 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 27b4bfccdd314b319f7903436d9c9069: Sending DeleteTablet for 3 replicas of tablet 7d8e34b3057a408995ac9c0df2bd22a8
I20260807 20:21:17.541900 25363 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d8e34b3057a408995ac9c0df2bd22a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:17 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:32868
I20260807 20:21:17.541989 25766 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d8e34b3057a408995ac9c0df2bd22a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:17 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:50878
I20260807 20:21:17.542191 25910 tablet_replica.cc:330] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2: stopping tablet replica
I20260807 20:21:17.542209 25556 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d8e34b3057a408995ac9c0df2bd22a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:17 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:51154
I20260807 20:21:17.542294 25910 raft_consensus.cc:2229] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:21:17.542464 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 25268
I20260807 20:21:17.542405 25910 raft_consensus.cc:2258] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:21:17.551994 25911 tablet_replica.cc:330] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8: stopping tablet replica
I20260807 20:21:17.552129 25911 raft_consensus.cc:2229] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:21:17.552253 25911 raft_consensus.cc:2258] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:21:17.552591 25910 ts_tablet_manager.cc:1905] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:21:17.552693 25911 ts_tablet_manager.cc:1905] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:21:17.554330 25911 ts_tablet_manager.cc:1918] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:21:17.554416 25911 log.cc:1196] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/7d8e34b3057a408995ac9c0df2bd22a8
I20260807 20:21:17.554508 25910 ts_tablet_manager.cc:1918] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:21:17.554579 25910 log.cc:1196] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/7d8e34b3057a408995ac9c0df2bd22a8
I20260807 20:21:17.554692 25911 ts_tablet_manager.cc:1939] T 7d8e34b3057a408995ac9c0df2bd22a8 P 4f1883ea8acc44b2a83ea871751c5aa8: Deleting consensus metadata
I20260807 20:21:17.554829 25910 ts_tablet_manager.cc:1939] T 7d8e34b3057a408995ac9c0df2bd22a8 P a06f2c8369bf4019b957923a4249a3a2: Deleting consensus metadata
I20260807 20:21:17.555163 25156 catalog_manager.cc:4841] TS a06f2c8369bf4019b957923a4249a3a2 (127.30.35.195:45729): tablet 7d8e34b3057a408995ac9c0df2bd22a8 (table test-table [id=af6ae5432a5440ab9845ae3cf22bfa53]) successfully deleted
I20260807 20:21:17.555250 25156 catalog_manager.cc:4841] TS 4f1883ea8acc44b2a83ea871751c5aa8 (127.30.35.194:40151): tablet 7d8e34b3057a408995ac9c0df2bd22a8 (table test-table [id=af6ae5432a5440ab9845ae3cf22bfa53]) successfully deleted
W20260807 20:21:17.561731 25157 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:35731 (error 108)
I20260807 20:21:17.561959 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 25468
I20260807 20:21:17.562286 25870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.562161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:35731 (local address 127.0.0.1:32884)
0807 20:21:17.562213 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:17.562250 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:35731: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260807 20:21:17.562443 25157 catalog_manager.cc:4584] TS 7e2abc6ebedd4c338193e818071099bb (127.30.35.193:35731): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7d8e34b3057a408995ac9c0df2bd22a8: Network error: Client connection negotiation failed: client connection to 127.30.35.193:35731: connect: Connection refused (error 111)
I20260807 20:21:17.571877 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 25666
I20260807 20:21:17.584599 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 25132
2026-08-07T20:21:17Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2114 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T20:21:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:17Z Disabled control of system clock
I20260807 20:21:17.620453 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:36857
--webserver_interface=127.30.35.254
--webserver_port=0
--builtin_ntp_servers=127.30.35.212:40887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:36857
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 20:21:17.701825 25918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:17.702039 25918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:17.702057 25918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:17.703115 25918 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:17.703147 25918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:17.703159 25918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:17.703169 25918 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:17.703183 25918 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:17.704475 25918 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:36857
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:36857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25918
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:17.704672 25918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:17.704907 25918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:17.709410 25924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:17.709458 25928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:17.709462 25918 server_base.cc:1034] running on GCE node
W20260807 20:21:17.709403 25923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:17.709842 25918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:17.710124 25918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:17.711273 25918 hybrid_clock.cc:648] HybridClock initialized: now 1786134077711260 us; error 34 us; skew 500 ppm
I20260807 20:21:17.712463 25918 webserver.cc:460] Webserver started at http://127.30.35.254:41801/ using document root <none> and password file <none>
I20260807 20:21:17.712692 25918 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:17.712738 25918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:17.712877 25918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:17.714002 25918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "623a078dd0414a2581efdef061657ee0"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "82816689c68567236dd3eac36799ea00"
server_key_iv: "99500d345a1ff1dec865092bcd2c9676"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.714350 25918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "623a078dd0414a2581efdef061657ee0"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "82816689c68567236dd3eac36799ea00"
server_key_iv: "99500d345a1ff1dec865092bcd2c9676"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.715605 25918 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:21:17.716284 25937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.716439 25918 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:17.716555 25918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "623a078dd0414a2581efdef061657ee0"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "82816689c68567236dd3eac36799ea00"
server_key_iv: "99500d345a1ff1dec865092bcd2c9676"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.716629 25918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:17.740119 25918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:17.740469 25918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:17.740602 25918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:17.744370 25918 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:36857
I20260807 20:21:17.744416 26005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:36857 every 8 connection(s)
I20260807 20:21:17.744750 25918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:17.744999 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 25918
I20260807 20:21:17.745116 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:17.745332 30863 external_mini_cluster.cc:1428] Setting key a8ab4ca3ecaf4d0947f9c0e94db3c02a
I20260807 20:21:17.745954 26006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:17.748924 26006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0: Bootstrap starting.
I20260807 20:21:17.749575 26006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:17.749908 26006 log.cc:824] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:17.750634 26006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0: No bootstrap required, opened a new log
I20260807 20:21:17.750782 26009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.745883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35770 (local address 127.30.35.254:36857)
0807 20:21:17.746117 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:17.746125 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:17.746152 (+ 27us) server_negotiation.cc:407] Connection header received
0807 20:21:17.746580 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:17.746587 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:17.746649 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:17.746762 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:17.746993 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.747839 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.748871 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.749303 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.749393 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.750103 (+ 710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:17.750108 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:17.750109 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:17.750269 (+ 160us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:17.750302 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:17.750312 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:17.750369 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:17.750463 (+ 94us) server_negotiation.cc:299] Negotiation successful
0807 20:21:17.750549 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":69,"threads_started":1}
I20260807 20:21:17.752544 26006 raft_consensus.cc:348] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "623a078dd0414a2581efdef061657ee0" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36857 } }
I20260807 20:21:17.752686 26006 raft_consensus.cc:374] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:17.752707 26006 raft_consensus.cc:729] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 623a078dd0414a2581efdef061657ee0, State: Initialized, Role: FOLLOWER
I20260807 20:21:17.752803 26006 consensus_queue.cc:260] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "623a078dd0414a2581efdef061657ee0" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36857 } }
I20260807 20:21:17.752879 26006 raft_consensus.cc:388] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:17.752907 26006 raft_consensus.cc:482] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:17.752939 26006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:17.753433 26006 raft_consensus.cc:504] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "623a078dd0414a2581efdef061657ee0" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36857 } }
I20260807 20:21:17.753522 26006 leader_election.cc:302] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 623a078dd0414a2581efdef061657ee0; no voters:
I20260807 20:21:17.753692 26006 leader_election.cc:288] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:17.753729 26012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:17.753868 26012 raft_consensus.cc:686] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [term 1 LEADER]: Becoming Leader. State: Replica: 623a078dd0414a2581efdef061657ee0, State: Running, Role: LEADER
I20260807 20:21:17.753953 26006 sys_catalog.cc:564] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:17.753964 26012 consensus_queue.cc:237] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "623a078dd0414a2581efdef061657ee0" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36857 } }
I20260807 20:21:17.754350 26013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "623a078dd0414a2581efdef061657ee0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "623a078dd0414a2581efdef061657ee0" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36857 } } }
I20260807 20:21:17.754451 26013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:17.754357 26014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 623a078dd0414a2581efdef061657ee0. Latest consensus state: current_term: 1 leader_uuid: "623a078dd0414a2581efdef061657ee0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "623a078dd0414a2581efdef061657ee0" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 36857 } } }
I20260807 20:21:17.754537 26014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:17.754737 26023 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:17.755234 26023 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:17.756788 26023 catalog_manager.cc:1347] Generated new cluster ID: a6c5795f7a73483e98d2e785a8cd352a
I20260807 20:21:17.756877 26023 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:17.767200 26023 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:17.767694 26023 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:17.777505 26023 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0: Generated new TSK 0
I20260807 20:21:17.777751 26023 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:17.779424 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36857
--builtin_ntp_servers=127.30.35.212:40887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 20:21:17.866510 26038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:17.866729 26038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:17.866757 26038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:17.867911 26038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:17.867955 26038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:17.867980 26038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:21:17.869314 26038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:17.869542 26038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:17.869866 26038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:17.874765 26045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:17.874773 26046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:17.875002 26051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:17.875180 26038 server_base.cc:1034] running on GCE node
I20260807 20:21:17.875389 26038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:17.875630 26038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:17.876807 26038 hybrid_clock.cc:648] HybridClock initialized: now 1786134077876793 us; error 28 us; skew 500 ppm
I20260807 20:21:17.878086 26038 webserver.cc:460] Webserver started at http://127.30.35.193:40821/ using document root <none> and password file <none>
I20260807 20:21:17.878324 26038 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:17.878371 26038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:17.878496 26038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:17.879608 26038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "67d5977646604a2d8a8979a3beb5765e"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "044db96e4cd10d7d1f8f670d0ee97d2d"
server_key_iv: "9f6c11d0283eed0104c6bdebd3a602c3"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.879956 26038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "67d5977646604a2d8a8979a3beb5765e"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "044db96e4cd10d7d1f8f670d0ee97d2d"
server_key_iv: "9f6c11d0283eed0104c6bdebd3a602c3"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.881210 26038 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:21:17.881937 26060 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.882097 26038 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.882186 26038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "67d5977646604a2d8a8979a3beb5765e"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "044db96e4cd10d7d1f8f670d0ee97d2d"
server_key_iv: "9f6c11d0283eed0104c6bdebd3a602c3"
server_key_version: "encryptionkey@0"
I20260807 20:21:17.882261 26038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:17.893823 26038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:17.894127 26038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:17.894261 26038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:17.894488 26038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:17.894816 26038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:17.894852 26038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.894876 26038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:17.894901 26038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:17.900223 26038 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:34593
I20260807 20:21:17.900291 26224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:34593 every 8 connection(s)
I20260807 20:21:17.900600 26038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:21:17.905508 26009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.901320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:57913 (local address 127.30.35.254:36857)
0807 20:21:17.901394 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:17.901397 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:17.901596 (+ 199us) server_negotiation.cc:407] Connection header received
0807 20:21:17.902128 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:17.902129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:17.902145 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:17.902196 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:17.902843 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.903341 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.904264 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.904439 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.904480 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.905268 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:17.905269 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:17.905269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:17.905274 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:17.905289 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:17.905293 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:17.905334 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:17.905396 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 20:21:17.905432 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 20:21:17.905704 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 26038
I20260807 20:21:17.905718 26229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:17.901295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:36857 (local address 127.30.35.193:57913)
0807 20:21:17.901481 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:17.901516 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:17.902032 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:17.902268 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:17.902271 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:17.902279 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:17.902782 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.902787 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.903401 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.903401 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.904204 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:17.904206 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:17.904501 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:17.904501 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:17.904631 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:17.905129 (+ 498us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:21:17.905129 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:17.905161 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:21:17.905187 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:17.905336 (+ 149us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:17.905338 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:17.905341 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:17.905386 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:21:17.905488 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":87,"threads_started":1}
I20260807 20:21:17.905808 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:21:17.906009 30863 external_mini_cluster.cc:1428] Setting key 2e67934466fb275735a54d2724c35707
I20260807 20:21:17.906404 26226 heartbeater.cc:347] Connected to a master server at 127.30.35.254:36857
I20260807 20:21:17.906502 26226 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:17.906697 26226 heartbeater.cc:511] Master 127.30.35.254:36857 requested a full tablet report, sending...
I20260807 20:21:17.906935 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36857
--builtin_ntp_servers=127.30.35.212:40887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 20:21:17.907271 25961 ts_manager.cc:194] Registered new tserver with Master: 67d5977646604a2d8a8979a3beb5765e (127.30.35.193:34593)
I20260807 20:21:17.907873 25961 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.35.193:57913
W20260807 20:21:17.988461 26230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:17.988723 26230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:17.988746 26230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:17.989883 26230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:17.989917 26230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:17.989940 26230 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:21:17.991223 26230 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:17.991436 26230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:17.991734 26230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:17.996554 26238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:17.996552 26241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:17.996563 26239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:17.996830 26230 server_base.cc:1034] running on GCE node
I20260807 20:21:17.997058 26230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:17.997277 26230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:17.998412 26230 hybrid_clock.cc:648] HybridClock initialized: now 1786134077998398 us; error 27 us; skew 500 ppm
I20260807 20:21:17.999637 26230 webserver.cc:460] Webserver started at http://127.30.35.194:37893/ using document root <none> and password file <none>
I20260807 20:21:17.999871 26230 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:17.999922 26230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:18.000056 26230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:18.001113 26230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "44fc2f4765894363a90424805dd65dca"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "4436d7a118448802071ec83854f8cdb3"
server_key_iv: "f9fc53e3703362552ef613d6a4514d4d"
server_key_version: "encryptionkey@0"
I20260807 20:21:18.001454 26230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "44fc2f4765894363a90424805dd65dca"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "4436d7a118448802071ec83854f8cdb3"
server_key_iv: "f9fc53e3703362552ef613d6a4514d4d"
server_key_version: "encryptionkey@0"
I20260807 20:21:18.002808 26230 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:21:18.003466 26256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:18.003626 26230 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:18.003711 26230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "44fc2f4765894363a90424805dd65dca"
format_stamp: "Formatted at 2026-08-07 20:21:17 on dist-test-slave-t7g5"
server_key: "4436d7a118448802071ec83854f8cdb3"
server_key_iv: "f9fc53e3703362552ef613d6a4514d4d"
server_key_version: "encryptionkey@0"
I20260807 20:21:18.003775 26230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:18.022328 26230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:18.022650 26230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:18.022782 26230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:18.023025 26230 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:18.023353 26230 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:18.023389 26230 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:18.023419 26230 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:18.023443 26230 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:18.028748 26230 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:37059
I20260807 20:21:18.028817 26416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:37059 every 8 connection(s)
I20260807 20:21:18.029156 26230 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:21:18.032536 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 26230
I20260807 20:21:18.032645 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:21:18.032828 30863 external_mini_cluster.cc:1428] Setting key 6e1cfd8b326ea2282d34e2127ed2e799
I20260807 20:21:18.033803 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36857
--builtin_ntp_servers=127.30.35.212:40887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 20:21:18.034399 26009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.029893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:58075 (local address 127.30.35.254:36857)
0807 20:21:18.029950 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:18.029951 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:18.030202 (+ 251us) server_negotiation.cc:407] Connection header received
0807 20:21:18.030711 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:18.030713 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:18.030726 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:18.030776 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:18.031483 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.031966 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.032968 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.033208 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.033264 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.034160 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:18.034161 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:18.034162 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:18.034166 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:18.034184 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:18.034188 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:18.034246 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:18.034296 (+ 50us) server_negotiation.cc:299] Negotiation successful
0807 20:21:18.034321 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 20:21:18.034595 26419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.029886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:36857 (local address 127.30.35.194:58075)
0807 20:21:18.030083 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:18.030118 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:18.030618 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:18.030860 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:18.030863 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:18.030872 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:18.031388 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:18.031393 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.032061 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.032061 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:18.032869 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:18.032873 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.033288 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.033289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:18.033441 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.034024 (+ 583us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:21:18.034024 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:18.034055 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:21:18.034079 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:18.034247 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:18.034249 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:18.034252 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:18.034295 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 20:21:18.034375 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":91,"threads_started":1}
I20260807 20:21:18.035174 26417 heartbeater.cc:347] Connected to a master server at 127.30.35.254:36857
I20260807 20:21:18.035264 26417 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:18.035439 26417 heartbeater.cc:511] Master 127.30.35.254:36857 requested a full tablet report, sending...
I20260807 20:21:18.035817 25961 ts_manager.cc:194] Registered new tserver with Master: 44fc2f4765894363a90424805dd65dca (127.30.35.194:37059)
I20260807 20:21:18.036171 25961 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.35.194:58075
W20260807 20:21:18.115510 26421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:18.115722 26421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:18.115741 26421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:18.116861 26421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:18.116904 26421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:18.116930 26421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:21:18.118299 26421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:36857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:18.118525 26421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:18.118813 26421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:18.123705 26428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:18.123728 26431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:18.123723 26429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:18.123821 26421 server_base.cc:1034] running on GCE node
I20260807 20:21:18.124145 26421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:18.124344 26421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:18.125480 26421 hybrid_clock.cc:648] HybridClock initialized: now 1786134078125466 us; error 32 us; skew 500 ppm
I20260807 20:21:18.126673 26421 webserver.cc:460] Webserver started at http://127.30.35.195:40137/ using document root <none> and password file <none>
I20260807 20:21:18.126891 26421 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:18.126941 26421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:18.127085 26421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:18.128139 26421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "f49ed2f704064a9dbf9b98a6829ae7ce"
format_stamp: "Formatted at 2026-08-07 20:21:18 on dist-test-slave-t7g5"
server_key: "41fbf389c8bfe7a36702c00e6c21062b"
server_key_iv: "aa2300278760720cce6306f9f1d1675a"
server_key_version: "encryptionkey@0"
I20260807 20:21:18.128474 26421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "f49ed2f704064a9dbf9b98a6829ae7ce"
format_stamp: "Formatted at 2026-08-07 20:21:18 on dist-test-slave-t7g5"
server_key: "41fbf389c8bfe7a36702c00e6c21062b"
server_key_iv: "aa2300278760720cce6306f9f1d1675a"
server_key_version: "encryptionkey@0"
I20260807 20:21:18.129698 26421 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:21:18.130427 26440 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:18.130582 26421 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:21:18.130671 26421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "f49ed2f704064a9dbf9b98a6829ae7ce"
format_stamp: "Formatted at 2026-08-07 20:21:18 on dist-test-slave-t7g5"
server_key: "41fbf389c8bfe7a36702c00e6c21062b"
server_key_iv: "aa2300278760720cce6306f9f1d1675a"
server_key_version: "encryptionkey@0"
I20260807 20:21:18.130738 26421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:18.148154 26421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:18.148465 26421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:18.148597 26421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:18.148813 26421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:18.149142 26421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:18.149178 26421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:18.149209 26421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:18.149235 26421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:18.154829 26421 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:37159
I20260807 20:21:18.154884 26603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:37159 every 8 connection(s)
I20260807 20:21:18.155217 26421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:21:18.159415 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 26421
I20260807 20:21:18.159510 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:21:18.159688 30863 external_mini_cluster.cc:1428] Setting key 6bd1d9a3e295cd894d28ea24460b2c01
I20260807 20:21:18.160166 26009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.155926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:56737 (local address 127.30.35.254:36857)
0807 20:21:18.155996 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:18.155998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:18.156223 (+ 225us) server_negotiation.cc:407] Connection header received
0807 20:21:18.156718 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:18.156719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:18.156729 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:18.156766 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:18.157394 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.157914 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.158840 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.159018 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.159062 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.159883 (+ 821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:18.159884 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:18.159884 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:18.159889 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:18.159903 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:18.159907 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:18.159966 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:18.160059 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 20:21:18.160086 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260807 20:21:18.160373 26607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.155907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:36857 (local address 127.30.35.195:56737)
0807 20:21:18.156106 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:18.156146 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:18.156620 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:18.156834 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:18.156838 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:18.156848 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:18.157328 (+ 480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:18.157333 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.157985 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.157986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:18.158777 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:18.158779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.159069 (+ 290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.159069 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:18.159173 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.159728 (+ 555us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:21:18.159729 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:18.159769 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:21:18.159799 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:18.159979 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:18.159987 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:18.159990 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:18.160059 (+ 69us) client_negotiation.cc:240] Negotiation successful
0807 20:21:18.160169 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
I20260807 20:21:18.160825 26605 heartbeater.cc:347] Connected to a master server at 127.30.35.254:36857
I20260807 20:21:18.160917 26605 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:18.161088 26605 heartbeater.cc:511] Master 127.30.35.254:36857 requested a full tablet report, sending...
I20260807 20:21:18.161428 25961 ts_manager.cc:194] Registered new tserver with Master: f49ed2f704064a9dbf9b98a6829ae7ce (127.30.35.195:37159)
I20260807 20:21:18.161839 25961 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.35.195:56737
I20260807 20:21:18.171362 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:21:18.175041 26009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.172622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35778 (local address 127.30.35.254:36857)
0807 20:21:18.172685 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:18.172687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:18.172772 (+ 85us) server_negotiation.cc:407] Connection header received
0807 20:21:18.172811 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:18.172812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:18.172820 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:18.172862 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:18.172975 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.173410 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.174128 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.174293 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.174335 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.174885 (+ 550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:18.174885 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:18.174886 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:18.174889 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:18.174898 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:18.174900 (+ 2us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:18.174926 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:18.174964 (+ 38us) server_negotiation.cc:299] Negotiation successful
0807 20:21:18.174978 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 20:21:18.176496 25961 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35778:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:21:18.178025 25961 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:21:18.183809 26622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.179976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:37059 (local address 127.0.0.1:53202)
0807 20:21:18.180284 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:18.180322 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:18.180399 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:18.180599 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:18.180603 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:18.180605 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:18.180668 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:18.180670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.181611 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.181612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:18.182734 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:18.182737 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.183527 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.183528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:18.183609 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.183623 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 20:21:18.183691 (+ 68us) client_negotiation.cc:240] Negotiation successful
0807 20:21:18.183735 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":85,"threads_started":1}
I20260807 20:21:18.183823 26621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.180087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53202 (local address 127.30.35.194:37059)
0807 20:21:18.180255 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:18.180259 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:18.180388 (+ 129us) server_negotiation.cc:407] Connection header received
0807 20:21:18.180497 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:18.180499 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:18.180515 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:18.180594 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:18.180751 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.181534 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.182814 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.183444 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.183513 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.183600 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:18.183704 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 20:21:18.183741 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":92,"threads_started":1}
I20260807 20:21:18.184294 26618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.180178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:34593 (local address 127.0.0.1:35726)
0807 20:21:18.180449 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:18.180458 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:18.180499 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:18.180748 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:18.180748 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:18.180751 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:18.180793 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:18.180795 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.182120 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.182121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:18.183078 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:18.183080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.184103 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.184104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:18.184161 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.184165 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:21:18.184217 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 20:21:18.184245 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":63,"threads_started":1}
I20260807 20:21:18.184378 26623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.180378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35726 (local address 127.30.35.193:34593)
0807 20:21:18.180550 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:18.180553 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:18.180563 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:21:18.180601 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:18.180603 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:18.180617 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:18.180696 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:18.180884 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.182037 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.183150 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.183825 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.184026 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.184094 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:18.184248 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 20:21:18.184287 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":109,"threads_started":1}
I20260807 20:21:18.184569 26318 tablet_service.cc:1467] Processing CreateTablet for tablet 83dbcccbcf7f4e32aac915721694486b (DEFAULT_TABLE table=test-table [id=0bd2b10d614f4715afa0627bd9796fc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:18.184958 26318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83dbcccbcf7f4e32aac915721694486b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:18.184998 26129 tablet_service.cc:1467] Processing CreateTablet for tablet 83dbcccbcf7f4e32aac915721694486b (DEFAULT_TABLE table=test-table [id=0bd2b10d614f4715afa0627bd9796fc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:18.185355 26129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83dbcccbcf7f4e32aac915721694486b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:18.185590 26617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.179968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:37159 (local address 127.0.0.1:56336)
0807 20:21:18.180279 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:18.180321 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:18.180548 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:18.180837 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:18.180838 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:18.180840 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:18.180869 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:18.180869 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.183145 (+ 2276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.183145 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:18.184407 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:18.184410 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.185371 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.185372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:18.185432 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.185435 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:18.185490 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 20:21:18.185527 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":73,"threads_started":1}
I20260807 20:21:18.185616 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.180041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56336 (local address 127.30.35.195:37159)
0807 20:21:18.180180 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:18.180185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:18.180396 (+ 211us) server_negotiation.cc:407] Connection header received
0807 20:21:18.180639 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:18.180642 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:18.180656 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:18.180704 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:18.180942 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.182037 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.184513 (+ 2476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.185190 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.185232 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.185313 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:18.185507 (+ 194us) server_negotiation.cc:299] Negotiation successful
0807 20:21:18.185544 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":78,"threads_started":1}
I20260807 20:21:18.186331 26512 tablet_service.cc:1467] Processing CreateTablet for tablet 83dbcccbcf7f4e32aac915721694486b (DEFAULT_TABLE table=test-table [id=0bd2b10d614f4715afa0627bd9796fc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:18.186618 26512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83dbcccbcf7f4e32aac915721694486b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:18.188390 26624 tablet_bootstrap.cc:492] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca: Bootstrap starting.
I20260807 20:21:18.188745 26625 tablet_bootstrap.cc:492] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e: Bootstrap starting.
I20260807 20:21:18.189180 26624 tablet_bootstrap.cc:654] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:18.189451 26625 tablet_bootstrap.cc:654] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:18.189764 26624 log.cc:824] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:18.189780 26625 log.cc:824] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:18.189813 26627 tablet_bootstrap.cc:492] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce: Bootstrap starting.
I20260807 20:21:18.190423 26627 tablet_bootstrap.cc:654] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:18.190518 26625 tablet_bootstrap.cc:492] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e: No bootstrap required, opened a new log
I20260807 20:21:18.190580 26625 ts_tablet_manager.cc:1397] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:21:18.190611 26624 tablet_bootstrap.cc:492] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca: No bootstrap required, opened a new log
I20260807 20:21:18.190670 26624 ts_tablet_manager.cc:1397] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 20:21:18.190730 26627 log.cc:824] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:18.191404 26627 tablet_bootstrap.cc:492] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce: No bootstrap required, opened a new log
I20260807 20:21:18.191464 26627 ts_tablet_manager.cc:1397] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:21:18.192993 26625 raft_consensus.cc:348] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49ed2f704064a9dbf9b98a6829ae7ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37159 } } peers { permanent_uuid: "44fc2f4765894363a90424805dd65dca" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37059 } } peers { permanent_uuid: "67d5977646604a2d8a8979a3beb5765e" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34593 } }
I20260807 20:21:18.193152 26625 raft_consensus.cc:374] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:18.193185 26625 raft_consensus.cc:729] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d5977646604a2d8a8979a3beb5765e, State: Initialized, Role: FOLLOWER
I20260807 20:21:18.193316 26625 consensus_queue.cc:260] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49ed2f704064a9dbf9b98a6829ae7ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37159 } } peers { permanent_uuid: "44fc2f4765894363a90424805dd65dca" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37059 } } peers { permanent_uuid: "67d5977646604a2d8a8979a3beb5765e" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34593 } }
I20260807 20:21:18.193583 26625 ts_tablet_manager.cc:1428] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:21:18.193735 26226 heartbeater.cc:503] Master 127.30.35.254:36857 was elected leader, sending a full tablet report...
I20260807 20:21:18.193811 26627 raft_consensus.cc:348] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49ed2f704064a9dbf9b98a6829ae7ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37159 } } peers { permanent_uuid: "44fc2f4765894363a90424805dd65dca" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37059 } } peers { permanent_uuid: "67d5977646604a2d8a8979a3beb5765e" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34593 } }
I20260807 20:21:18.193970 26627 raft_consensus.cc:374] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:18.194005 26627 raft_consensus.cc:729] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49ed2f704064a9dbf9b98a6829ae7ce, State: Initialized, Role: FOLLOWER
I20260807 20:21:18.194108 26627 consensus_queue.cc:260] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49ed2f704064a9dbf9b98a6829ae7ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37159 } } peers { permanent_uuid: "44fc2f4765894363a90424805dd65dca" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37059 } } peers { permanent_uuid: "67d5977646604a2d8a8979a3beb5765e" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34593 } }
I20260807 20:21:18.194362 26627 ts_tablet_manager.cc:1428] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260807 20:21:18.194541 26605 heartbeater.cc:503] Master 127.30.35.254:36857 was elected leader, sending a full tablet report...
I20260807 20:21:18.193166 26624 raft_consensus.cc:348] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49ed2f704064a9dbf9b98a6829ae7ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37159 } } peers { permanent_uuid: "44fc2f4765894363a90424805dd65dca" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37059 } } peers { permanent_uuid: "67d5977646604a2d8a8979a3beb5765e" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34593 } }
I20260807 20:21:18.194918 26624 raft_consensus.cc:374] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:18.194965 26624 raft_consensus.cc:729] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44fc2f4765894363a90424805dd65dca, State: Initialized, Role: FOLLOWER
I20260807 20:21:18.195101 26624 consensus_queue.cc:260] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49ed2f704064a9dbf9b98a6829ae7ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37159 } } peers { permanent_uuid: "44fc2f4765894363a90424805dd65dca" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37059 } } peers { permanent_uuid: "67d5977646604a2d8a8979a3beb5765e" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34593 } }
I20260807 20:21:18.195340 26624 ts_tablet_manager.cc:1428] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20260807 20:21:18.195447 26417 heartbeater.cc:503] Master 127.30.35.254:36857 was elected leader, sending a full tablet report...
W20260807 20:21:18.279703 26418 tablet.cc:2369] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:21:18.401276 26228 tablet.cc:2369] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:21:18.405776 26606 tablet.cc:2369] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:21:18.423026 26635 raft_consensus.cc:482] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:21:18.423162 26635 raft_consensus.cc:504] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49ed2f704064a9dbf9b98a6829ae7ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37159 } } peers { permanent_uuid: "44fc2f4765894363a90424805dd65dca" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37059 } } peers { permanent_uuid: "67d5977646604a2d8a8979a3beb5765e" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34593 } }
I20260807 20:21:18.423552 26635 leader_election.cc:288] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49ed2f704064a9dbf9b98a6829ae7ce (127.30.35.195:37159), 67d5977646604a2d8a8979a3beb5765e (127.30.35.193:34593)
I20260807 20:21:18.427433 26620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.423825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:50727 (local address 127.30.35.195:37159)
0807 20:21:18.423904 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:18.423906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:18.424043 (+ 137us) server_negotiation.cc:407] Connection header received
0807 20:21:18.424094 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:18.424095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:18.424101 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:18.424142 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:18.424270 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.424947 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.426516 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.427077 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.427144 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.427153 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:18.427310 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 20:21:18.427353 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 20:21:18.427433 26623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.423863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:39983 (local address 127.30.35.193:34593)
0807 20:21:18.423904 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:18.423906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:18.423915 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:21:18.423953 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:18.423953 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:18.423962 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:18.424011 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:18.424185 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.424932 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.426515 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.427063 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.427144 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.427153 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:18.427310 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 20:21:18.427355 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:21:18.427441 26419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.423745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:34593 (local address 127.30.35.194:39983)
0807 20:21:18.423793 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:18.423805 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:18.423855 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:18.424040 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:18.424041 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:18.424043 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:18.424116 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:18.424118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.425022 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.425023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:18.426421 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:18.426423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.427150 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.427151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:18.427237 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.427242 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:21:18.427298 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 20:21:18.427345 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25,"mutex_wait_us":96}
I20260807 20:21:18.427448 26636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.423751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:37159 (local address 127.30.35.194:50727)
0807 20:21:18.423978 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:18.423985 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:18.424045 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:18.424154 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:18.424155 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:18.424157 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:18.424215 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:18.424216 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.425020 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.425021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:18.426411 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:18.426415 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.427166 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.427167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:18.427237 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.427242 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:21:18.427298 (+ 56us) client_negotiation.cc:240] Negotiation successful
0807 20:21:18.427342 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":101,"thread_start_us":104,"threads_started":1}
I20260807 20:21:18.427867 26158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83dbcccbcf7f4e32aac915721694486b" candidate_uuid: "44fc2f4765894363a90424805dd65dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d5977646604a2d8a8979a3beb5765e" is_pre_election: true
I20260807 20:21:18.428053 26158 raft_consensus.cc:2454] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44fc2f4765894363a90424805dd65dca in term 0.
I20260807 20:21:18.428133 26545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83dbcccbcf7f4e32aac915721694486b" candidate_uuid: "44fc2f4765894363a90424805dd65dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49ed2f704064a9dbf9b98a6829ae7ce" is_pre_election: true
I20260807 20:21:18.428298 26545 raft_consensus.cc:2454] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44fc2f4765894363a90424805dd65dca in term 0.
I20260807 20:21:18.428320 26258 leader_election.cc:302] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44fc2f4765894363a90424805dd65dca, 67d5977646604a2d8a8979a3beb5765e; no voters:
I20260807 20:21:18.428453 26635 raft_consensus.cc:2781] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:21:18.428535 26635 raft_consensus.cc:482] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:21:18.428558 26635 raft_consensus.cc:3037] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:18.429261 26635 raft_consensus.cc:504] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49ed2f704064a9dbf9b98a6829ae7ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37159 } } peers { permanent_uuid: "44fc2f4765894363a90424805dd65dca" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37059 } } peers { permanent_uuid: "67d5977646604a2d8a8979a3beb5765e" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34593 } }
I20260807 20:21:18.429412 26635 leader_election.cc:288] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [CANDIDATE]: Term 1 election: Requested vote from peers f49ed2f704064a9dbf9b98a6829ae7ce (127.30.35.195:37159), 67d5977646604a2d8a8979a3beb5765e (127.30.35.193:34593)
I20260807 20:21:18.429564 26158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83dbcccbcf7f4e32aac915721694486b" candidate_uuid: "44fc2f4765894363a90424805dd65dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d5977646604a2d8a8979a3beb5765e"
I20260807 20:21:18.429581 26545 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83dbcccbcf7f4e32aac915721694486b" candidate_uuid: "44fc2f4765894363a90424805dd65dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49ed2f704064a9dbf9b98a6829ae7ce"
I20260807 20:21:18.429642 26158 raft_consensus.cc:3037] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:18.429668 26545 raft_consensus.cc:3037] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:18.430385 26545 raft_consensus.cc:2454] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44fc2f4765894363a90424805dd65dca in term 1.
I20260807 20:21:18.430455 26158 raft_consensus.cc:2454] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44fc2f4765894363a90424805dd65dca in term 1.
I20260807 20:21:18.430620 26258 leader_election.cc:302] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44fc2f4765894363a90424805dd65dca, 67d5977646604a2d8a8979a3beb5765e; no voters:
I20260807 20:21:18.430727 26635 raft_consensus.cc:2781] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:18.430871 26635 raft_consensus.cc:686] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [term 1 LEADER]: Becoming Leader. State: Replica: 44fc2f4765894363a90424805dd65dca, State: Running, Role: LEADER
I20260807 20:21:18.430948 26635 consensus_queue.cc:237] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49ed2f704064a9dbf9b98a6829ae7ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37159 } } peers { permanent_uuid: "44fc2f4765894363a90424805dd65dca" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37059 } } peers { permanent_uuid: "67d5977646604a2d8a8979a3beb5765e" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34593 } }
I20260807 20:21:18.431723 25961 catalog_manager.cc:5495] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca reported cstate change: term changed from 0 to 1, leader changed from <none> to 44fc2f4765894363a90424805dd65dca (127.30.35.194). New cstate: current_term: 1 leader_uuid: "44fc2f4765894363a90424805dd65dca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49ed2f704064a9dbf9b98a6829ae7ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44fc2f4765894363a90424805dd65dca" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 37059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67d5977646604a2d8a8979a3beb5765e" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34593 } health_report { overall_health: UNKNOWN } } }
I20260807 20:21:18.468037 26621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.465710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53210 (local address 127.30.35.194:37059)
0807 20:21:18.465765 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:18.465767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:18.465777 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:21:18.465845 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:18.465846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:18.465869 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:18.465932 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:18.466061 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.466530 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.467263 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:18.467462 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:18.467517 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:18.467675 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:18.467780 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:18.467853 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:18.467903 (+ 50us) server_negotiation.cc:299] Negotiation successful
0807 20:21:18.467922 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 20:21:18.469913 26545 raft_consensus.cc:1261] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce [term 1 FOLLOWER]: Refusing update from remote peer 44fc2f4765894363a90424805dd65dca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:18.469914 26158 raft_consensus.cc:1261] T 83dbcccbcf7f4e32aac915721694486b P 67d5977646604a2d8a8979a3beb5765e [term 1 FOLLOWER]: Refusing update from remote peer 44fc2f4765894363a90424805dd65dca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:18.470252 26635 consensus_queue.cc:1035] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f49ed2f704064a9dbf9b98a6829ae7ce" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 37159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:18.470403 26639 consensus_queue.cc:1035] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "67d5977646604a2d8a8979a3beb5765e" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34593 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:18.475400 25960 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:21:18.475518 25960 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:21:18.476253 25960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 623a078dd0414a2581efdef061657ee0: Sending DeleteTablet for 3 replicas of tablet 83dbcccbcf7f4e32aac915721694486b
I20260807 20:21:18.476614 26318 tablet_service.cc:1514] Processing DeleteTablet for tablet 83dbcccbcf7f4e32aac915721694486b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:18 UTC) from {username='slave'} at 127.0.0.1:53202
I20260807 20:21:18.476681 26512 tablet_service.cc:1514] Processing DeleteTablet for tablet 83dbcccbcf7f4e32aac915721694486b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:18 UTC) from {username='slave'} at 127.0.0.1:56336
I20260807 20:21:18.476799 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 26038
I20260807 20:21:18.476897 26129 tablet_service.cc:1514] Processing DeleteTablet for tablet 83dbcccbcf7f4e32aac915721694486b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:18 UTC) from {username='slave'} at 127.0.0.1:35726
I20260807 20:21:18.482787 26656 tablet_replica.cc:330] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca: stopping tablet replica
I20260807 20:21:18.482813 26657 tablet_replica.cc:330] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce: stopping tablet replica
I20260807 20:21:18.482882 26656 raft_consensus.cc:2229] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:21:18.482972 26656 raft_consensus.cc:2258] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:21:18.482920 26657 raft_consensus.cc:2229] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:21:18.483188 26657 raft_consensus.cc:2258] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:21:18.483402 26656 ts_tablet_manager.cc:1905] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:21:18.483655 26657 ts_tablet_manager.cc:1905] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:21:18.484918 26656 ts_tablet_manager.cc:1918] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:21:18.484987 26656 log.cc:1196] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/83dbcccbcf7f4e32aac915721694486b
I20260807 20:21:18.485224 26656 ts_tablet_manager.cc:1939] T 83dbcccbcf7f4e32aac915721694486b P 44fc2f4765894363a90424805dd65dca: Deleting consensus metadata
I20260807 20:21:18.485314 26657 ts_tablet_manager.cc:1918] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:21:18.485388 26657 log.cc:1196] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/83dbcccbcf7f4e32aac915721694486b
I20260807 20:21:18.485608 26657 ts_tablet_manager.cc:1939] T 83dbcccbcf7f4e32aac915721694486b P f49ed2f704064a9dbf9b98a6829ae7ce: Deleting consensus metadata
I20260807 20:21:18.485631 25939 catalog_manager.cc:4841] TS 44fc2f4765894363a90424805dd65dca (127.30.35.194:37059): tablet 83dbcccbcf7f4e32aac915721694486b (table test-table [id=0bd2b10d614f4715afa0627bd9796fc1]) successfully deleted
I20260807 20:21:18.486013 25938 catalog_manager.cc:4841] TS f49ed2f704064a9dbf9b98a6829ae7ce (127.30.35.195:37159): tablet 83dbcccbcf7f4e32aac915721694486b (table test-table [id=0bd2b10d614f4715afa0627bd9796fc1]) successfully deleted
W20260807 20:21:18.489367 25939 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:34593 (error 108)
I20260807 20:21:18.489634 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 26230
I20260807 20:21:18.489837 26617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:18.489729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:34593 (local address 127.0.0.1:35740)
0807 20:21:18.489773 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:18.489805 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:34593: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260807 20:21:18.499956 25939 catalog_manager.cc:4584] TS 67d5977646604a2d8a8979a3beb5765e (127.30.35.193:34593): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 83dbcccbcf7f4e32aac915721694486b: Network error: Client connection negotiation failed: client connection to 127.30.35.193:34593: connect: Connection refused (error 111)
I20260807 20:21:18.503587 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 26421
I20260807 20:21:18.513952 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 25918
2026-08-07T20:21:18Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (926 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:18 dist-test-slave-t7g5 krb5kdc[26661](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:18 dist-test-slave-t7g5 krb5kdc[26661](info): set up 2 sockets
Aug 07 20:21:18 dist-test-slave-t7g5 krb5kdc[26661](info): commencing operation
krb5kdc: starting...
W20260807 20:21:19.643347 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:19 dist-test-slave-t7g5 krb5kdc[26661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:21:19.765533 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:44705
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:44705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:19.846078 26681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:19.846287 26681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:19.846316 26681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:19.847414 26681 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:19.847455 26681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:19.847473 26681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:19.847489 26681 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:19.847504 26681 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:19.848909 26681 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:44705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:44705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:19.849141 26681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:19.849341 26681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:19.853905 26686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:19.853942 26689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:19.854096 26681 server_base.cc:1034] running on GCE node
W20260807 20:21:19.853904 26691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:19.854429 26681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:19.854686 26681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:19.855831 26681 hybrid_clock.cc:648] HybridClock initialized: now 1786134079855813 us; error 34 us; skew 500 ppm
Aug 07 20:21:19 dist-test-slave-t7g5 krb5kdc[26661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134079, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:19.858258 26681 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:21:19.858651 26681 webserver.cc:460] Webserver started at http://127.30.35.254:46649/ using document root <none> and password file <none>
I20260807 20:21:19.858825 26681 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:19.858865 26681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:19.858955 26681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:19.859902 26681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "eb3e2d7c9f97486a920cf09c5f83de88"
format_stamp: "Formatted at 2026-08-07 20:21:19 on dist-test-slave-t7g5"
server_key: "8183677233b4831d89d58aa3129f9451"
server_key_iv: "6ee085efe793ac44a624a1d5f786cfda"
server_key_version: "encryptionkey@0"
I20260807 20:21:19.860184 26681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "eb3e2d7c9f97486a920cf09c5f83de88"
format_stamp: "Formatted at 2026-08-07 20:21:19 on dist-test-slave-t7g5"
server_key: "8183677233b4831d89d58aa3129f9451"
server_key_iv: "6ee085efe793ac44a624a1d5f786cfda"
server_key_version: "encryptionkey@0"
I20260807 20:21:19.861325 26681 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 20:21:19.861979 26702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:19.862118 26681 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:19.862196 26681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "eb3e2d7c9f97486a920cf09c5f83de88"
format_stamp: "Formatted at 2026-08-07 20:21:19 on dist-test-slave-t7g5"
server_key: "8183677233b4831d89d58aa3129f9451"
server_key_iv: "6ee085efe793ac44a624a1d5f786cfda"
server_key_version: "encryptionkey@0"
I20260807 20:21:19.862267 26681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:19.886323 26681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:19.888666 26681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:19.888806 26681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:19.893186 26681 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:44705
I20260807 20:21:19.893222 26765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:44705 every 8 connection(s)
I20260807 20:21:19.893587 26681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:19.894508 26766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:19.896838 26766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88: Bootstrap starting.
I20260807 20:21:19.897379 26766 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:19.897624 26766 log.cc:824] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:19.898306 26766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88: No bootstrap required, opened a new log
I20260807 20:21:19.899827 26766 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb3e2d7c9f97486a920cf09c5f83de88" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44705 } }
I20260807 20:21:19.900038 26766 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:19.900054 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 26681
I20260807 20:21:19.900086 26766 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3e2d7c9f97486a920cf09c5f83de88, State: Initialized, Role: FOLLOWER
I20260807 20:21:19.900154 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:19.900249 26766 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb3e2d7c9f97486a920cf09c5f83de88" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44705 } }
I20260807 20:21:19.900334 26766 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:19.900364 26766 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:19.900362 30863 external_mini_cluster.cc:1428] Setting key aba94d58199ea937a3ffa08938b5be7b
I20260807 20:21:19.900413 26766 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:19.901065 26766 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb3e2d7c9f97486a920cf09c5f83de88" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44705 } }
I20260807 20:21:19.901183 26766 leader_election.cc:302] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb3e2d7c9f97486a920cf09c5f83de88; no voters:
I20260807 20:21:19.901357 26766 leader_election.cc:288] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:19.901391 26772 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:19.901511 26772 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [term 1 LEADER]: Becoming Leader. State: Replica: eb3e2d7c9f97486a920cf09c5f83de88, State: Running, Role: LEADER
I20260807 20:21:19.901614 26766 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:19.901603 26772 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb3e2d7c9f97486a920cf09c5f83de88" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44705 } }
I20260807 20:21:19.902076 26773 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb3e2d7c9f97486a920cf09c5f83de88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb3e2d7c9f97486a920cf09c5f83de88" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44705 } } }
I20260807 20:21:19.902158 26773 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:19.902347 26774 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb3e2d7c9f97486a920cf09c5f83de88. Latest consensus state: current_term: 1 leader_uuid: "eb3e2d7c9f97486a920cf09c5f83de88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb3e2d7c9f97486a920cf09c5f83de88" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44705 } } }
I20260807 20:21:19.902400 26774 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:19.902779 26776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:19.903311 26776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:19.905467 26776 catalog_manager.cc:1347] Generated new cluster ID: 473eb201426f4682b000b8a7d572c165
I20260807 20:21:19.905522 26776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:21:19 dist-test-slave-t7g5 krb5kdc[26661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134079, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:19.912110 26771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:19.901166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58396 (local address 127.30.35.254:44705)
0807 20:21:19.901370 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:19.901380 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:19.901417 (+ 37us) server_negotiation.cc:407] Connection header received
0807 20:21:19.901557 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:19.901564 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:19.901622 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:19.901828 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:19.902637 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:19.904041 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:19.905069 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:19.905571 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:19.905701 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:19.908567 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:19.908572 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:19.908572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:19.908584 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:19.910486 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:19.910898 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:19.910901 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:19.910902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:19.911018 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:19.911211 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:19.911212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:19.911212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:19.911503 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:19.911648 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:19.911760 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 20:21:19.911894 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":146,"thread_start_us":83,"threads_started":1}
I20260807 20:21:19.915427 26776 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:19.915912 26776 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:19.922365 26776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88: Generated new TSK 0
I20260807 20:21:19.922554 26776 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:21:19.956241 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:44705
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:20.062388 26799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:20.062616 26799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:20.062647 26799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:20.063796 26799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:20.063839 26799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:20.063872 26799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:21:20.065402 26799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:44705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:20.065686 26799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:20.065922 26799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:20.070782 26808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:20.070770 26810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:20.070770 26806 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:20.070983 26799 server_base.cc:1034] running on GCE node
I20260807 20:21:20.071184 26799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:20.071398 26799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:20.072530 26799 hybrid_clock.cc:648] HybridClock initialized: now 1786134080072518 us; error 27 us; skew 500 ppm
Aug 07 20:21:20 dist-test-slave-t7g5 krb5kdc[26661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134080, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:20.075110 26799 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:21:20.075578 26799 webserver.cc:460] Webserver started at http://127.30.35.193:38887/ using document root <none> and password file <none>
I20260807 20:21:20.075809 26799 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:20.075855 26799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:20.075987 26799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:20.077016 26799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "66aa68e287f44227abbc2e0239e18ba6"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "aa22a70445a2ac25538b1bd601b19f8f"
server_key_iv: "207f1a0806d023858ebc3e220470d75a"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.077350 26799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "66aa68e287f44227abbc2e0239e18ba6"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "aa22a70445a2ac25538b1bd601b19f8f"
server_key_iv: "207f1a0806d023858ebc3e220470d75a"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.078691 26799 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:21:20.079367 26827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.079542 26799 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.079630 26799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "66aa68e287f44227abbc2e0239e18ba6"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "aa22a70445a2ac25538b1bd601b19f8f"
server_key_iv: "207f1a0806d023858ebc3e220470d75a"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.079687 26799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:20.091138 26799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:20.093317 26799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:20.093434 26799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:20.093619 26799 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:20.093930 26799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:20.093962 26799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.093983 26799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:20.093999 26799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.099490 26799 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:36251
I20260807 20:21:20.099532 26986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:36251 every 8 connection(s)
I20260807 20:21:20.099845 26799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:21:20.102165 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 26799
I20260807 20:21:20.102286 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:21:20.102501 30863 external_mini_cluster.cc:1428] Setting key 80088d2e6f88860f79a131fc2b9bb5a5
Aug 07 20:21:20 dist-test-slave-t7g5 krb5kdc[26661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134080, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:20.109687 26771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.100544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:36485 (local address 127.30.35.254:44705)
0807 20:21:20.100609 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:20.100611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:20.100794 (+ 183us) server_negotiation.cc:407] Connection header received
0807 20:21:20.101283 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:20.101285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:20.101295 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:20.101342 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:20.102499 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.103287 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.104603 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.104810 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.104878 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.107048 (+ 2170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:20.107050 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:20.107050 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:20.107059 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:20.108365 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:20.108741 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:20.108742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:20.108743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:20.108807 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:20.109026 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:20.109027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:20.109027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:20.109136 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:20.109194 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:20.109465 (+ 271us) server_negotiation.cc:299] Negotiation successful
0807 20:21:20.109570 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 20:21:20.109870 26989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.100506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:44705 (local address 127.30.35.193:36485)
0807 20:21:20.100676 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:20.100714 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:20.101186 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:20.101408 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:20.101411 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:20.102091 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:20.102405 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.102413 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.103381 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.103382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.104527 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.104531 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.104895 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.104896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.105045 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.105574 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:20.105582 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:20.106957 (+ 1375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:20.108443 (+ 1486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:20.108450 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:20.108452 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:20.108674 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:20.108861 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:20.108862 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:20.108862 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:20.108971 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:20.109192 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:20.109200 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:20.109344 (+ 144us) client_negotiation.cc:769] Sending connection context
0807 20:21:20.109433 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 20:21:20.109591 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":94,"threads_started":1}
I20260807 20:21:20.110291 26987 heartbeater.cc:347] Connected to a master server at 127.30.35.254:44705
I20260807 20:21:20.110381 26987 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:20.110556 26987 heartbeater.cc:511] Master 127.30.35.254:44705 requested a full tablet report, sending...
I20260807 20:21:20.111047 26721 ts_manager.cc:194] Registered new tserver with Master: 66aa68e287f44227abbc2e0239e18ba6 (127.30.35.193:36251)
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
I20260807 20:21:20.111688 26721 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:36485
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:21:20.127833 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:44705
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:20.211110 26993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:20.211313 26993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:20.211333 26993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:20.212422 26993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:20.212473 26993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:20.212500 26993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:21:20.213943 26993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:44705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:20.214130 26993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:20.214308 26993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:20.219208 27000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:20.219184 27001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:20.219208 26993 server_base.cc:1034] running on GCE node
W20260807 20:21:20.219322 27005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:20.219640 26993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:20.219880 26993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:20.221033 26993 hybrid_clock.cc:648] HybridClock initialized: now 1786134080221018 us; error 32 us; skew 500 ppm
Aug 07 20:21:20 dist-test-slave-t7g5 krb5kdc[26661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134080, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:20.223557 26993 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:21:20.223987 26993 webserver.cc:460] Webserver started at http://127.30.35.194:44155/ using document root <none> and password file <none>
I20260807 20:21:20.224190 26993 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:20.224234 26993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:20.224340 26993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:20.225394 26993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "8cda18b728124732b47dd6a74e7d1183"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "64e10958a85c4aa05104714cc4af568a"
server_key_iv: "4f227383f7d5217efac411ea2f6f062d"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.225765 26993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "8cda18b728124732b47dd6a74e7d1183"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "64e10958a85c4aa05104714cc4af568a"
server_key_iv: "4f227383f7d5217efac411ea2f6f062d"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.227051 26993 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:21:20.227859 27014 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.228021 26993 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:21:20.228116 26993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "8cda18b728124732b47dd6a74e7d1183"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "64e10958a85c4aa05104714cc4af568a"
server_key_iv: "4f227383f7d5217efac411ea2f6f062d"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.228183 26993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:20.248839 26993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:20.250819 26993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:20.250949 26993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:20.251189 26993 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:20.251502 26993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:20.251535 26993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.251560 26993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:20.251585 26993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.257210 26993 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:43037
I20260807 20:21:20.257272 27168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:43037 every 8 connection(s)
I20260807 20:21:20.257570 26993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:21:20.263237 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 26993
Aug 07 20:21:20 dist-test-slave-t7g5 krb5kdc[26661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134080, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:20.263366 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:21:20.263572 30863 external_mini_cluster.cc:1428] Setting key 4ecb23728276608a7b2e5b66ee857ca0
I20260807 20:21:20.266803 26771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.258279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:38391 (local address 127.30.35.254:44705)
0807 20:21:20.258363 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:20.258365 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:20.258508 (+ 143us) server_negotiation.cc:407] Connection header received
0807 20:21:20.258975 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:20.258977 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:20.258987 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:20.259037 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:20.259961 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.260469 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.261428 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.261625 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.261723 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.263867 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:20.263868 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:20.263869 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:20.263875 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:20.265428 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:20.265863 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:20.265865 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:20.265865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:20.265931 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:20.266158 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:20.266159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:20.266159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:20.266286 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:20.266349 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:20.266612 (+ 263us) server_negotiation.cc:299] Negotiation successful
0807 20:21:20.266705 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 20:21:20.266945 27171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.258243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:44705 (local address 127.30.35.194:38391)
0807 20:21:20.258388 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:20.258426 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:20.258899 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:20.259094 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:20.259097 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:20.259671 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:20.259876 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.259881 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.260537 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.260538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.261340 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.261343 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.261729 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.261730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.261863 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.262269 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:20.262277 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:20.263771 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:20.265507 (+ 1736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:20.265514 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:20.265516 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:20.265793 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:20.265987 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:20.265988 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:20.265988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:20.266091 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:20.266348 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:20.266355 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:20.266491 (+ 136us) client_negotiation.cc:769] Sending connection context
0807 20:21:20.266580 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 20:21:20.266734 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":89,"threads_started":1}
I20260807 20:21:20.267614 27169 heartbeater.cc:347] Connected to a master server at 127.30.35.254:44705
I20260807 20:21:20.267710 27169 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:20.267887 27169 heartbeater.cc:511] Master 127.30.35.254:44705 requested a full tablet report, sending...
I20260807 20:21:20.268267 26721 ts_manager.cc:194] Registered new tserver with Master: 8cda18b728124732b47dd6a74e7d1183 (127.30.35.194:43037)
I20260807 20:21:20.268739 26721 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:38391
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:21:20.288734 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:44705
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33091
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:20.369172 27175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:20.369390 27175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:20.369421 27175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:20.370554 27175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:20.370597 27175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:20.370631 27175 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:21:20.372051 27175 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33091
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:44705
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:20.372283 27175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:20.372490 27175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:20.377069 27182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:20.377226 27175 server_base.cc:1034] running on GCE node
W20260807 20:21:20.377077 27180 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:20.377065 27187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:20.377502 27175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:20.377750 27175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:20.378881 27175 hybrid_clock.cc:648] HybridClock initialized: now 1786134080378873 us; error 27 us; skew 500 ppm
Aug 07 20:21:20 dist-test-slave-t7g5 krb5kdc[26661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134080, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:20.381250 27175 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:21:20.381695 27175 webserver.cc:460] Webserver started at http://127.30.35.195:46813/ using document root <none> and password file <none>
I20260807 20:21:20.381892 27175 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:20.381940 27175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:20.382077 27175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:20.383136 27175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "247f26c96e7b41d7b3f09eb325db2a11"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "dc55e1f254b4aee1fe9ac82b53d0cfae"
server_key_iv: "21d52643c390d3221ff0fc8d1f730808"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.383469 27175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "247f26c96e7b41d7b3f09eb325db2a11"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "dc55e1f254b4aee1fe9ac82b53d0cfae"
server_key_iv: "21d52643c390d3221ff0fc8d1f730808"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.384680 27175 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:21:20.385304 27194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.385459 27175 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:21:20.385545 27175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "247f26c96e7b41d7b3f09eb325db2a11"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "dc55e1f254b4aee1fe9ac82b53d0cfae"
server_key_iv: "21d52643c390d3221ff0fc8d1f730808"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.385605 27175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:20.392030 27175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:20.394027 27175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:20.394156 27175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:20.394338 27175 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:20.394624 27175 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:20.394658 27175 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.394685 27175 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:20.394711 27175 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.400084 27175 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:40901
I20260807 20:21:20.400118 27349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:40901 every 8 connection(s)
I20260807 20:21:20.400408 27175 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:21:20.402946 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 27175
I20260807 20:21:20.403055 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:21:20.403232 30863 external_mini_cluster.cc:1428] Setting key f67fcbd87e9e84cbd4b0e20179fae584
Aug 07 20:21:20 dist-test-slave-t7g5 krb5kdc[26661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134080, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:20.409416 26771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.401071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:39991 (local address 127.30.35.254:44705)
0807 20:21:20.401128 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:20.401130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:20.401296 (+ 166us) server_negotiation.cc:407] Connection header received
0807 20:21:20.401868 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:20.401869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:20.401880 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:20.401919 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:20.402888 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.403588 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.404732 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.404922 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.404974 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.407073 (+ 2099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:20.407074 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:20.407075 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:20.407082 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:20.408164 (+ 1082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:20.408540 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:20.408541 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:20.408542 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:20.408598 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:20.408826 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:20.408827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:20.408827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:20.408939 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:20.408995 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:20.409248 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 20:21:20.409328 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 20:21:20.409584 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.401035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:44705 (local address 127.30.35.195:39991)
0807 20:21:20.401183 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:20.401223 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:20.401751 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:20.401995 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:20.401998 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:20.402596 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:20.402806 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.402811 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.403776 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.403777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.404664 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.404667 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.404988 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.404989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.405090 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.405546 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:20.405554 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:20.406969 (+ 1415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:20.408249 (+ 1280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:20.408256 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:20.408258 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:20.408472 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:20.408651 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:20.408652 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:20.408652 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:20.408768 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:20.408994 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:20.409000 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:20.409131 (+ 131us) client_negotiation.cc:769] Sending connection context
0807 20:21:20.409218 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 20:21:20.409376 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":79,"threads_started":1}
I20260807 20:21:20.410058 27350 heartbeater.cc:347] Connected to a master server at 127.30.35.254:44705
I20260807 20:21:20.410140 27350 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:20.410307 27350 heartbeater.cc:511] Master 127.30.35.254:44705 requested a full tablet report, sending...
I20260807 20:21:20.410627 26721 ts_manager.cc:194] Registered new tserver with Master: 247f26c96e7b41d7b3f09eb325db2a11 (127.30.35.195:40901)
I20260807 20:21:20.410972 26721 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:39991
I20260807 20:21:20.414914 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:21:20.421706 26771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.416169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58402 (local address 127.30.35.254:44705)
0807 20:21:20.416223 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:20.416225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:20.416334 (+ 109us) server_negotiation.cc:407] Connection header received
0807 20:21:20.416395 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:20.416396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:20.416405 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:20.416457 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:20.416946 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.417419 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.418138 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.418337 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.418390 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.419568 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:20.419569 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:20.419569 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:20.419576 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:20.420535 (+ 959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:20.420907 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:20.420908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:20.420908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:20.420961 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:20.421148 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:20.421149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:20.421149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:20.421283 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:20.421383 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:20.421521 (+ 138us) server_negotiation.cc:299] Negotiation successful
0807 20:21:20.421586 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 20:21:20.423239 26721 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58402:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:21:20.424719 26721 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:21:20.430872 27367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.426979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34334 (local address 127.30.35.194:43037)
0807 20:21:20.427163 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:20.427168 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:20.427318 (+ 150us) server_negotiation.cc:407] Connection header received
0807 20:21:20.427434 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:20.427437 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:20.427452 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:20.427505 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:20.427791 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.428519 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.429850 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.430489 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.430557 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.430620 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:20.430744 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 20:21:20.430780 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":73,"threads_started":1}
I20260807 20:21:20.430884 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.426853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:43037 (local address 127.0.0.1:34334)
0807 20:21:20.427195 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:20.427236 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:20.427346 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:20.427623 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:20.427626 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:20.427628 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:20.427703 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.427704 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.428609 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.428609 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.429722 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.429725 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.430562 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.430563 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.430643 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.430657 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 20:21:20.430723 (+ 66us) client_negotiation.cc:240] Negotiation successful
0807 20:21:20.430776 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":2,"thread_start_us":78,"threads_started":1}
I20260807 20:21:20.431289 27365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.426857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:36251 (local address 127.0.0.1:35374)
0807 20:21:20.427215 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:20.427235 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:20.427308 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:20.427658 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:20.427659 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:20.427661 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:20.427717 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.427720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.429027 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.429028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.430131 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.430133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.431081 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.431082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.431135 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.431138 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:20.431193 (+ 55us) client_negotiation.cc:240] Negotiation successful
0807 20:21:20.431229 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":43,"thread_start_us":58,"threads_started":1}
I20260807 20:21:20.431361 27372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.427163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60692 (local address 127.30.35.195:40901)
0807 20:21:20.427332 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:20.427348 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:20.427360 (+ 12us) server_negotiation.cc:407] Connection header received
0807 20:21:20.427450 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:20.427452 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:20.427467 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:20.427531 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:20.427800 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.428918 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.430034 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.430735 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.431152 (+ 417us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.431214 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:20.431239 (+ 25us) server_negotiation.cc:299] Negotiation successful
0807 20:21:20.431278 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":75,"threads_started":1}
I20260807 20:21:20.431360 27369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.427050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35374 (local address 127.30.35.193:36251)
0807 20:21:20.427256 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:20.427260 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:20.427390 (+ 130us) server_negotiation.cc:407] Connection header received
0807 20:21:20.427433 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:20.427436 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:20.427452 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:20.427527 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:20.427800 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.428922 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.430217 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.430946 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.431000 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.431050 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:20.431229 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 20:21:20.431277 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":82,"threads_started":1}
I20260807 20:21:20.431080 27368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.427061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:40901 (local address 127.0.0.1:60692)
0807 20:21:20.427311 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:20.427321 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:20.427375 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:20.427624 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:20.427627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:20.427629 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:20.427717 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.427719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.429033 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.429034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.429957 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.429960 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.430855 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.430856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.430932 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.430937 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:21:20.430968 (+ 31us) client_negotiation.cc:240] Negotiation successful
0807 20:21:20.431008 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":35,"thread_start_us":75,"threads_started":1}
I20260807 20:21:20.431999 26896 tablet_service.cc:1467] Processing CreateTablet for tablet caf4ea89614c451399a37b137f9c907d (DEFAULT_TABLE table=test-table [id=d1c43dbb452d4ed68add8eb910dc8b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:20.431998 27086 tablet_service.cc:1467] Processing CreateTablet for tablet caf4ea89614c451399a37b137f9c907d (DEFAULT_TABLE table=test-table [id=d1c43dbb452d4ed68add8eb910dc8b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:20.432096 27265 tablet_service.cc:1467] Processing CreateTablet for tablet caf4ea89614c451399a37b137f9c907d (DEFAULT_TABLE table=test-table [id=d1c43dbb452d4ed68add8eb910dc8b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:20.432359 26896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf4ea89614c451399a37b137f9c907d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:20.432359 27086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf4ea89614c451399a37b137f9c907d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:20.432397 27265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet caf4ea89614c451399a37b137f9c907d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:20.435012 27374 tablet_bootstrap.cc:492] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11: Bootstrap starting.
I20260807 20:21:20.435570 27375 tablet_bootstrap.cc:492] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183: Bootstrap starting.
I20260807 20:21:20.435796 27374 tablet_bootstrap.cc:654] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:20.436251 27375 tablet_bootstrap.cc:654] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:20.436391 27374 log.cc:824] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:20.436821 27375 log.cc:824] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:20.437158 27376 tablet_bootstrap.cc:492] T caf4ea89614c451399a37b137f9c907d P 66aa68e287f44227abbc2e0239e18ba6: Bootstrap starting.
I20260807 20:21:20.437204 27374 tablet_bootstrap.cc:492] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11: No bootstrap required, opened a new log
I20260807 20:21:20.437269 27374 ts_tablet_manager.cc:1397] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:21:20.437556 27375 tablet_bootstrap.cc:492] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183: No bootstrap required, opened a new log
I20260807 20:21:20.437628 27375 ts_tablet_manager.cc:1397] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:21:20.437738 27376 tablet_bootstrap.cc:654] T caf4ea89614c451399a37b137f9c907d P 66aa68e287f44227abbc2e0239e18ba6: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:20.438249 27376 log.cc:824] T caf4ea89614c451399a37b137f9c907d P 66aa68e287f44227abbc2e0239e18ba6: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:20.438866 27376 tablet_bootstrap.cc:492] T caf4ea89614c451399a37b137f9c907d P 66aa68e287f44227abbc2e0239e18ba6: No bootstrap required, opened a new log
I20260807 20:21:20.438925 27376 ts_tablet_manager.cc:1397] T caf4ea89614c451399a37b137f9c907d P 66aa68e287f44227abbc2e0239e18ba6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 20:21:20.439205 27374 raft_consensus.cc:348] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cda18b728124732b47dd6a74e7d1183" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 43037 } } peers { permanent_uuid: "247f26c96e7b41d7b3f09eb325db2a11" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40901 } } peers { permanent_uuid: "66aa68e287f44227abbc2e0239e18ba6" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36251 } }
I20260807 20:21:20.439409 27374 raft_consensus.cc:374] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:20.439458 27374 raft_consensus.cc:729] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 247f26c96e7b41d7b3f09eb325db2a11, State: Initialized, Role: FOLLOWER
I20260807 20:21:20.439489 27375 raft_consensus.cc:348] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cda18b728124732b47dd6a74e7d1183" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 43037 } } peers { permanent_uuid: "247f26c96e7b41d7b3f09eb325db2a11" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40901 } } peers { permanent_uuid: "66aa68e287f44227abbc2e0239e18ba6" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36251 } }
I20260807 20:21:20.439595 27374 consensus_queue.cc:260] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cda18b728124732b47dd6a74e7d1183" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 43037 } } peers { permanent_uuid: "247f26c96e7b41d7b3f09eb325db2a11" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40901 } } peers { permanent_uuid: "66aa68e287f44227abbc2e0239e18ba6" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36251 } }
I20260807 20:21:20.439648 27375 raft_consensus.cc:374] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:20.439688 27375 raft_consensus.cc:729] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cda18b728124732b47dd6a74e7d1183, State: Initialized, Role: FOLLOWER
I20260807 20:21:20.439810 27375 consensus_queue.cc:260] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cda18b728124732b47dd6a74e7d1183" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 43037 } } peers { permanent_uuid: "247f26c96e7b41d7b3f09eb325db2a11" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40901 } } peers { permanent_uuid: "66aa68e287f44227abbc2e0239e18ba6" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36251 } }
I20260807 20:21:20.439890 27374 ts_tablet_manager.cc:1428] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:21:20.440063 27375 ts_tablet_manager.cc:1428] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:21:20.440135 27350 heartbeater.cc:503] Master 127.30.35.254:44705 was elected leader, sending a full tablet report...
I20260807 20:21:20.440166 27169 heartbeater.cc:503] Master 127.30.35.254:44705 was elected leader, sending a full tablet report...
I20260807 20:21:20.440641 27376 raft_consensus.cc:348] T caf4ea89614c451399a37b137f9c907d P 66aa68e287f44227abbc2e0239e18ba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cda18b728124732b47dd6a74e7d1183" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 43037 } } peers { permanent_uuid: "247f26c96e7b41d7b3f09eb325db2a11" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40901 } } peers { permanent_uuid: "66aa68e287f44227abbc2e0239e18ba6" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36251 } }
I20260807 20:21:20.440773 27376 raft_consensus.cc:374] T caf4ea89614c451399a37b137f9c907d P 66aa68e287f44227abbc2e0239e18ba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:20.440804 27376 raft_consensus.cc:729] T caf4ea89614c451399a37b137f9c907d P 66aa68e287f44227abbc2e0239e18ba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66aa68e287f44227abbc2e0239e18ba6, State: Initialized, Role: FOLLOWER
I20260807 20:21:20.440918 27376 consensus_queue.cc:260] T caf4ea89614c451399a37b137f9c907d P 66aa68e287f44227abbc2e0239e18ba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cda18b728124732b47dd6a74e7d1183" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 43037 } } peers { permanent_uuid: "247f26c96e7b41d7b3f09eb325db2a11" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40901 } } peers { permanent_uuid: "66aa68e287f44227abbc2e0239e18ba6" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36251 } }
I20260807 20:21:20.441202 26987 heartbeater.cc:503] Master 127.30.35.254:44705 was elected leader, sending a full tablet report...
I20260807 20:21:20.441190 27376 ts_tablet_manager.cc:1428] T caf4ea89614c451399a37b137f9c907d P 66aa68e287f44227abbc2e0239e18ba6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 20:21:20.468858 27383 raft_consensus.cc:482] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:21:20.468978 27383 raft_consensus.cc:504] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cda18b728124732b47dd6a74e7d1183" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 43037 } } peers { permanent_uuid: "247f26c96e7b41d7b3f09eb325db2a11" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40901 } } peers { permanent_uuid: "66aa68e287f44227abbc2e0239e18ba6" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36251 } }
I20260807 20:21:20.469357 27383 leader_election.cc:288] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cda18b728124732b47dd6a74e7d1183 (127.30.35.194:43037), 66aa68e287f44227abbc2e0239e18ba6 (127.30.35.193:36251)
I20260807 20:21:20.472047 27367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.469609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:52641 (local address 127.30.35.194:43037)
0807 20:21:20.469677 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:20.469678 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:20.469686 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:21:20.469711 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:20.469712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:20.469723 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:20.469777 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:20.469947 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.470434 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.471365 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.471731 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.471789 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.471798 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:20.471946 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 20:21:20.471981 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 20:21:20.472062 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.469492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:43037 (local address 127.30.35.195:52641)
0807 20:21:20.469529 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:20.469541 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:20.469586 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:20.469794 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:20.469796 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:20.469798 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:20.469872 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.469874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.470508 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.470509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.471280 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.471282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.471806 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.471807 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.471884 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.471887 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:20.471934 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 20:21:20.471976 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17,"mutex_wait_us":27}
I20260807 20:21:20.472052 27369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.469580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:34927 (local address 127.30.35.193:36251)
0807 20:21:20.469624 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:20.469627 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:20.469762 (+ 135us) server_negotiation.cc:407] Connection header received
0807 20:21:20.469808 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:20.469809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:20.469819 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:20.469881 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:20.470022 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.470468 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.471375 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.471741 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.471807 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.471815 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:20.471945 (+ 130us) server_negotiation.cc:299] Negotiation successful
0807 20:21:20.471988 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:21:20.472078 27386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.469505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:36251 (local address 127.30.35.195:34927)
0807 20:21:20.469702 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:20.469711 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:20.469759 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:20.469889 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:20.469890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:20.469891 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:20.469960 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.469962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.470545 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.470546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.471292 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.471293 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.471819 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.471820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.471881 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.471885 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:21:20.471932 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 20:21:20.471973 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":2,"thread_start_us":111,"threads_started":1}
I20260807 20:21:20.472422 27112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf4ea89614c451399a37b137f9c907d" candidate_uuid: "247f26c96e7b41d7b3f09eb325db2a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cda18b728124732b47dd6a74e7d1183" is_pre_election: true
I20260807 20:21:20.472425 26922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf4ea89614c451399a37b137f9c907d" candidate_uuid: "247f26c96e7b41d7b3f09eb325db2a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66aa68e287f44227abbc2e0239e18ba6" is_pre_election: true
I20260807 20:21:20.472577 26922 raft_consensus.cc:2454] T caf4ea89614c451399a37b137f9c907d P 66aa68e287f44227abbc2e0239e18ba6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 247f26c96e7b41d7b3f09eb325db2a11 in term 0.
I20260807 20:21:20.472577 27112 raft_consensus.cc:2454] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 247f26c96e7b41d7b3f09eb325db2a11 in term 0.
I20260807 20:21:20.472800 27197 leader_election.cc:302] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247f26c96e7b41d7b3f09eb325db2a11, 8cda18b728124732b47dd6a74e7d1183; no voters:
I20260807 20:21:20.472934 27383 raft_consensus.cc:2781] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:21:20.472986 27383 raft_consensus.cc:482] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:21:20.473013 27383 raft_consensus.cc:3037] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:20.473752 27383 raft_consensus.cc:504] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cda18b728124732b47dd6a74e7d1183" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 43037 } } peers { permanent_uuid: "247f26c96e7b41d7b3f09eb325db2a11" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40901 } } peers { permanent_uuid: "66aa68e287f44227abbc2e0239e18ba6" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36251 } }
I20260807 20:21:20.473873 27383 leader_election.cc:288] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [CANDIDATE]: Term 1 election: Requested vote from peers 8cda18b728124732b47dd6a74e7d1183 (127.30.35.194:43037), 66aa68e287f44227abbc2e0239e18ba6 (127.30.35.193:36251)
I20260807 20:21:20.473997 27112 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf4ea89614c451399a37b137f9c907d" candidate_uuid: "247f26c96e7b41d7b3f09eb325db2a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cda18b728124732b47dd6a74e7d1183"
I20260807 20:21:20.474059 26922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "caf4ea89614c451399a37b137f9c907d" candidate_uuid: "247f26c96e7b41d7b3f09eb325db2a11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66aa68e287f44227abbc2e0239e18ba6"
I20260807 20:21:20.474076 27112 raft_consensus.cc:3037] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:20.474128 26922 raft_consensus.cc:3037] T caf4ea89614c451399a37b137f9c907d P 66aa68e287f44227abbc2e0239e18ba6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:20.474941 27112 raft_consensus.cc:2454] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 247f26c96e7b41d7b3f09eb325db2a11 in term 1.
I20260807 20:21:20.474941 26922 raft_consensus.cc:2454] T caf4ea89614c451399a37b137f9c907d P 66aa68e287f44227abbc2e0239e18ba6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 247f26c96e7b41d7b3f09eb325db2a11 in term 1.
I20260807 20:21:20.475116 27197 leader_election.cc:302] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 247f26c96e7b41d7b3f09eb325db2a11, 8cda18b728124732b47dd6a74e7d1183; no voters:
I20260807 20:21:20.475225 27383 raft_consensus.cc:2781] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:20.475401 27383 raft_consensus.cc:686] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [term 1 LEADER]: Becoming Leader. State: Replica: 247f26c96e7b41d7b3f09eb325db2a11, State: Running, Role: LEADER
I20260807 20:21:20.475504 27383 consensus_queue.cc:237] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cda18b728124732b47dd6a74e7d1183" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 43037 } } peers { permanent_uuid: "247f26c96e7b41d7b3f09eb325db2a11" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40901 } } peers { permanent_uuid: "66aa68e287f44227abbc2e0239e18ba6" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36251 } }
I20260807 20:21:20.476307 26721 catalog_manager.cc:5495] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 247f26c96e7b41d7b3f09eb325db2a11 (127.30.35.195). New cstate: current_term: 1 leader_uuid: "247f26c96e7b41d7b3f09eb325db2a11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8cda18b728124732b47dd6a74e7d1183" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 43037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "247f26c96e7b41d7b3f09eb325db2a11" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 40901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66aa68e287f44227abbc2e0239e18ba6" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36251 } health_report { overall_health: UNKNOWN } } }
I20260807 20:21:20.490705 27372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.488649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60696 (local address 127.30.35.195:40901)
0807 20:21:20.488705 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:20.488707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:20.488715 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:21:20.488743 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:20.488743 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:20.488757 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:20.488814 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:20.488957 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.489401 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.490145 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.490319 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.490364 (+ 45us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.490461 (+ 97us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:20.490543 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:20.490606 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:20.490624 (+ 18us) server_negotiation.cc:299] Negotiation successful
0807 20:21:20.490633 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 20:21:20.492323 26922 raft_consensus.cc:1261] T caf4ea89614c451399a37b137f9c907d P 66aa68e287f44227abbc2e0239e18ba6 [term 1 FOLLOWER]: Refusing update from remote peer 247f26c96e7b41d7b3f09eb325db2a11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:20.492323 27112 raft_consensus.cc:1261] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183 [term 1 FOLLOWER]: Refusing update from remote peer 247f26c96e7b41d7b3f09eb325db2a11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:20.492651 27383 consensus_queue.cc:1035] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cda18b728124732b47dd6a74e7d1183" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 43037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:20.492785 27387 consensus_queue.cc:1035] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66aa68e287f44227abbc2e0239e18ba6" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:20.495321 27392 mvcc.cc:205] Tried to move back new op lower bound from 7316005193694232576 to 7316005193628348416. Current Snapshot: MvccSnapshot[applied={T|T < 7316005193694232576}]
I20260807 20:21:20.495918 27393 mvcc.cc:205] Tried to move back new op lower bound from 7316005193694232576 to 7316005193628348416. Current Snapshot: MvccSnapshot[applied={T|T < 7316005193694232576}]
I20260807 20:21:20.497817 26722 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:21:20.497910 26722 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58402:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:21:20.498636 26722 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb3e2d7c9f97486a920cf09c5f83de88: Sending DeleteTablet for 3 replicas of tablet caf4ea89614c451399a37b137f9c907d
I20260807 20:21:20.498982 27265 tablet_service.cc:1514] Processing DeleteTablet for tablet caf4ea89614c451399a37b137f9c907d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:20 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:60692
I20260807 20:21:20.499035 27086 tablet_service.cc:1514] Processing DeleteTablet for tablet caf4ea89614c451399a37b137f9c907d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:20 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:34334
I20260807 20:21:20.499044 26896 tablet_service.cc:1514] Processing DeleteTablet for tablet caf4ea89614c451399a37b137f9c907d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:20 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:35374
I20260807 20:21:20.499277 27402 tablet_replica.cc:330] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11: stopping tablet replica
I20260807 20:21:20.499365 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 26799
I20260807 20:21:20.513352 27402 raft_consensus.cc:2229] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:21:20.513557 27402 raft_consensus.cc:2258] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:21:20.513597 27403 tablet_replica.cc:330] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183: stopping tablet replica
I20260807 20:21:20.513741 27403 raft_consensus.cc:2229] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:21:20.513867 27403 raft_consensus.cc:2258] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:21:20.514164 27402 ts_tablet_manager.cc:1905] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:21:20.514329 27403 ts_tablet_manager.cc:1905] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:21:20.515935 27403 ts_tablet_manager.cc:1918] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:21:20.515941 27402 ts_tablet_manager.cc:1918] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:21:20.516016 27403 log.cc:1196] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/caf4ea89614c451399a37b137f9c907d
I20260807 20:21:20.516134 27402 log.cc:1196] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/caf4ea89614c451399a37b137f9c907d
I20260807 20:21:20.516273 27403 ts_tablet_manager.cc:1939] T caf4ea89614c451399a37b137f9c907d P 8cda18b728124732b47dd6a74e7d1183: Deleting consensus metadata
I20260807 20:21:20.516510 27402 ts_tablet_manager.cc:1939] T caf4ea89614c451399a37b137f9c907d P 247f26c96e7b41d7b3f09eb325db2a11: Deleting consensus metadata
I20260807 20:21:20.516748 26704 catalog_manager.cc:4841] TS 8cda18b728124732b47dd6a74e7d1183 (127.30.35.194:43037): tablet caf4ea89614c451399a37b137f9c907d (table test-table [id=d1c43dbb452d4ed68add8eb910dc8b96]) successfully deleted
I20260807 20:21:20.517143 26704 catalog_manager.cc:4841] TS 247f26c96e7b41d7b3f09eb325db2a11 (127.30.35.195:40901): tablet caf4ea89614c451399a37b137f9c907d (table test-table [id=d1c43dbb452d4ed68add8eb910dc8b96]) successfully deleted
W20260807 20:21:20.518532 26705 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:36251 (error 108)
I20260807 20:21:20.519063 27364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.518933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:36251 (local address 127.0.0.1:35384)
0807 20:21:20.518987 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:20.519027 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:36251: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 20:21:20.519085 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 26993
W20260807 20:21:20.535434 26705 catalog_manager.cc:4584] TS 66aa68e287f44227abbc2e0239e18ba6 (127.30.35.193:36251): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet caf4ea89614c451399a37b137f9c907d: Network error: Client connection negotiation failed: client connection to 127.30.35.193:36251: connect: Connection refused (error 111)
I20260807 20:21:20.539602 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 27175
I20260807 20:21:20.548254 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 26681
2026-08-07T20:21:20Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2036 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T20:21:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:20Z Disabled control of system clock
I20260807 20:21:20.582864 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:42883
--webserver_interface=127.30.35.254
--webserver_port=0
--builtin_ntp_servers=127.30.35.212:33331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:42883
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 20:21:20.663730 27415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:20.663951 27415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:20.663970 27415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:20.665063 27415 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:20.665097 27415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:20.665108 27415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:20.665119 27415 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:20.665130 27415 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:20.666453 27415 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:42883
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:42883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:20.666705 27415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:20.666957 27415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:20.671489 27422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:20.671630 27415 server_base.cc:1034] running on GCE node
W20260807 20:21:20.671485 27423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:20.671489 27425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:20.672025 27415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:20.672313 27415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:20.673473 27415 hybrid_clock.cc:648] HybridClock initialized: now 1786134080673457 us; error 32 us; skew 500 ppm
I20260807 20:21:20.674875 27415 webserver.cc:460] Webserver started at http://127.30.35.254:45817/ using document root <none> and password file <none>
I20260807 20:21:20.675105 27415 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:20.675155 27415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:20.675287 27415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:20.676364 27415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "ac7194e040fb457f83a050538cc3af69"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "246c4d01e7eb0cb9db21ff27a4760448"
server_key_iv: "0c7115e986b5037115f3aa478411cb90"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.676723 27415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "ac7194e040fb457f83a050538cc3af69"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "246c4d01e7eb0cb9db21ff27a4760448"
server_key_iv: "0c7115e986b5037115f3aa478411cb90"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.678047 27415 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260807 20:21:20.678844 27434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.679015 27415 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:21:20.679103 27415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "ac7194e040fb457f83a050538cc3af69"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "246c4d01e7eb0cb9db21ff27a4760448"
server_key_iv: "0c7115e986b5037115f3aa478411cb90"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.679167 27415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:20.691901 27415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:20.692212 27415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:20.692342 27415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:20.696288 27415 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:42883
I20260807 20:21:20.696336 27501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:42883 every 8 connection(s)
I20260807 20:21:20.696658 27415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:20.697116 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 27415
I20260807 20:21:20.697209 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:20.697397 30863 external_mini_cluster.cc:1428] Setting key 0e46672bcdc12693f10bd50d8e5c2e62
I20260807 20:21:20.697710 27502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:20.700775 27502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69: Bootstrap starting.
I20260807 20:21:20.701411 27502 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:20.701759 27502 log.cc:824] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:20.702564 27502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69: No bootstrap required, opened a new log
I20260807 20:21:20.703179 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.697936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46916 (local address 127.30.35.254:42883)
0807 20:21:20.698133 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:20.698141 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:20.698166 (+ 25us) server_negotiation.cc:407] Connection header received
0807 20:21:20.698829 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:20.698836 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:20.698902 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:20.699032 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:20.699269 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.700123 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.701178 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.701614 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.701773 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.702499 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:20.702503 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:20.702503 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:20.702685 (+ 182us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:20.702727 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:20.702739 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:20.702789 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:20.702886 (+ 97us) server_negotiation.cc:299] Negotiation successful
0807 20:21:20.702968 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260807 20:21:20.704522 27502 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7194e040fb457f83a050538cc3af69" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 42883 } }
I20260807 20:21:20.704658 27502 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:20.704679 27502 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac7194e040fb457f83a050538cc3af69, State: Initialized, Role: FOLLOWER
I20260807 20:21:20.704792 27502 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7194e040fb457f83a050538cc3af69" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 42883 } }
I20260807 20:21:20.704857 27502 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:20.704890 27502 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:20.704933 27502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:20.705435 27502 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7194e040fb457f83a050538cc3af69" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 42883 } }
I20260807 20:21:20.705538 27502 leader_election.cc:302] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac7194e040fb457f83a050538cc3af69; no voters:
I20260807 20:21:20.705734 27502 leader_election.cc:288] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:20.705781 27507 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:20.705925 27507 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [term 1 LEADER]: Becoming Leader. State: Replica: ac7194e040fb457f83a050538cc3af69, State: Running, Role: LEADER
I20260807 20:21:20.705984 27502 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:20.706143 27507 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7194e040fb457f83a050538cc3af69" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 42883 } }
I20260807 20:21:20.706516 27508 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac7194e040fb457f83a050538cc3af69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7194e040fb457f83a050538cc3af69" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 42883 } } }
I20260807 20:21:20.706607 27508 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:20.706632 27509 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac7194e040fb457f83a050538cc3af69. Latest consensus state: current_term: 1 leader_uuid: "ac7194e040fb457f83a050538cc3af69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac7194e040fb457f83a050538cc3af69" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 42883 } } }
I20260807 20:21:20.706678 27509 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:20.706856 27518 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:20.707333 27518 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:20.708761 27518 catalog_manager.cc:1347] Generated new cluster ID: c81d02e4815841c99e33d57f62c66656
I20260807 20:21:20.708817 27518 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:20.724895 27518 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:20.725484 27518 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:20.740742 27518 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69: Generated new TSK 0
I20260807 20:21:20.740983 27518 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:20.745398 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:42883
--builtin_ntp_servers=127.30.35.212:33331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 20:21:20.833248 27534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:20.833470 27534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:20.833491 27534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:20.834640 27534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:20.834681 27534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:20.834704 27534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:21:20.836069 27534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:42883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:20.836297 27534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:20.836592 27534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:20.842236 27540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:20.842247 27541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:20.842406 27543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:20.842525 27534 server_base.cc:1034] running on GCE node
I20260807 20:21:20.842759 27534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:20.843019 27534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:20.844197 27534 hybrid_clock.cc:648] HybridClock initialized: now 1786134080844180 us; error 32 us; skew 500 ppm
I20260807 20:21:20.845541 27534 webserver.cc:460] Webserver started at http://127.30.35.193:43077/ using document root <none> and password file <none>
I20260807 20:21:20.845752 27534 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:20.845791 27534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:20.845890 27534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:20.846885 27534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "a96bc242e2544d2485585c14c5af385c"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "95bbfe0dea29f257e3182ff1e09d7d4b"
server_key_iv: "9c4df4ca6633c88886ebd188cde1f861"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.847177 27534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "a96bc242e2544d2485585c14c5af385c"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "95bbfe0dea29f257e3182ff1e09d7d4b"
server_key_iv: "9c4df4ca6633c88886ebd188cde1f861"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.848340 27534 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:21:20.848958 27552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.849117 27534 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:20.849206 27534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "a96bc242e2544d2485585c14c5af385c"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "95bbfe0dea29f257e3182ff1e09d7d4b"
server_key_iv: "9c4df4ca6633c88886ebd188cde1f861"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.849277 27534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:20.860196 27534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:20.860538 27534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:20.860679 27534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:20.860905 27534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:20.861236 27534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:20.861281 27534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.861313 27534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:20.861334 27534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.866947 27534 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:43469
I20260807 20:21:20.866994 27714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:43469 every 8 connection(s)
I20260807 20:21:20.867341 27534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:21:20.871994 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 27534
I20260807 20:21:20.872123 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:21:20.872344 30863 external_mini_cluster.cc:1428] Setting key bf91d427c003d87dc93205dbcab75761
I20260807 20:21:20.872644 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.868140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:38953 (local address 127.30.35.254:42883)
0807 20:21:20.868207 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:20.868209 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:20.868444 (+ 235us) server_negotiation.cc:407] Connection header received
0807 20:21:20.868921 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:20.868922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:20.868935 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:20.868997 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:20.869687 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.870202 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.871179 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.871375 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.871431 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.872322 (+ 891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:20.872324 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:20.872324 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:20.872329 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:20.872345 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:20.872349 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:20.872416 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:20.872511 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 20:21:20.872560 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260807 20:21:20.872828 27720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:20.868103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:42883 (local address 127.30.35.193:38953)
0807 20:21:20.868317 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:20.868362 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:20.868845 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:20.869063 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:20.869066 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:20.869075 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:20.869592 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.869596 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.870296 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.870297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.871098 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:20.871100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:20.871467 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:20.871468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:20.871588 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:20.872143 (+ 555us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:21:20.872144 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:20.872186 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:21:20.872217 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:20.872426 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:20.872432 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:20.872435 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:20.872508 (+ 73us) client_negotiation.cc:240] Negotiation successful
0807 20:21:20.872606 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":98,"threads_started":1}
I20260807 20:21:20.873205 27716 heartbeater.cc:347] Connected to a master server at 127.30.35.254:42883
I20260807 20:21:20.873304 27716 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:20.873464 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:42883
--builtin_ntp_servers=127.30.35.212:33331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 20:21:20.873487 27716 heartbeater.cc:511] Master 127.30.35.254:42883 requested a full tablet report, sending...
I20260807 20:21:20.874019 27459 ts_manager.cc:194] Registered new tserver with Master: a96bc242e2544d2485585c14c5af385c (127.30.35.193:43469)
I20260807 20:21:20.874699 27459 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.35.193:38953
W20260807 20:21:20.954815 27722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:20.955025 27722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:20.955044 27722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:20.956187 27722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:20.956228 27722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:20.956254 27722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:21:20.957576 27722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:42883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:20.957824 27722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:20.958103 27722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:20.962817 27730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:20.962883 27728 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:20.962865 27722 server_base.cc:1034] running on GCE node
W20260807 20:21:20.962826 27733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:20.963155 27722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:20.963388 27722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:20.964529 27722 hybrid_clock.cc:648] HybridClock initialized: now 1786134080964515 us; error 25 us; skew 500 ppm
I20260807 20:21:20.965790 27722 webserver.cc:460] Webserver started at http://127.30.35.194:37181/ using document root <none> and password file <none>
I20260807 20:21:20.966035 27722 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:20.966089 27722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:20.966220 27722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:20.967257 27722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "05337dce0ad244dea06ded107fcc9f20"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "242faf10c03f9e20093c4e0e52bf8366"
server_key_iv: "e38559a109008b2ebbd76c995c355f00"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.967610 27722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "05337dce0ad244dea06ded107fcc9f20"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "242faf10c03f9e20093c4e0e52bf8366"
server_key_iv: "e38559a109008b2ebbd76c995c355f00"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.968866 27722 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:21:20.969561 27744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.969718 27722 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:20.969799 27722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "05337dce0ad244dea06ded107fcc9f20"
format_stamp: "Formatted at 2026-08-07 20:21:20 on dist-test-slave-t7g5"
server_key: "242faf10c03f9e20093c4e0e52bf8366"
server_key_iv: "e38559a109008b2ebbd76c995c355f00"
server_key_version: "encryptionkey@0"
I20260807 20:21:20.969867 27722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:20.994571 27722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:20.994880 27722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:20.995019 27722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:20.995260 27722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:20.995615 27722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:20.995651 27722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:20.995673 27722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:20.995697 27722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:21.001086 27722 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:40333
I20260807 20:21:21.001142 27912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:40333 every 8 connection(s)
I20260807 20:21:21.001469 27722 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:21:21.006713 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.002202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:52093 (local address 127.30.35.254:42883)
0807 20:21:21.002243 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:21.002245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:21.002488 (+ 243us) server_negotiation.cc:407] Connection header received
0807 20:21:21.003005 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:21.003007 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:21.003020 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:21.003068 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:21.003792 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.004281 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.005280 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.005497 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.005555 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.006448 (+ 893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:21.006449 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:21.006449 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:21.006455 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:21.006471 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:21.006476 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:21.006522 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:21.006623 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 20:21:21.006650 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 20:21:21.006964 27919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.002183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:42883 (local address 127.30.35.194:52093)
0807 20:21:21.002366 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:21.002403 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:21.002902 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:21.003157 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:21.003160 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:21.003169 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:21.003686 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:21.003690 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.004376 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.004378 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:21.005189 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:21.005191 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.005576 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.005578 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:21.005726 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.006296 (+ 570us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:21:21.006296 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:21.006327 (+ 31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:21:21.006352 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:21.006531 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:21.006535 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:21.006538 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:21.006627 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 20:21:21.006717 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
I20260807 20:21:21.007421 27913 heartbeater.cc:347] Connected to a master server at 127.30.35.254:42883
I20260807 20:21:21.007513 27913 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:21.007707 27913 heartbeater.cc:511] Master 127.30.35.254:42883 requested a full tablet report, sending...
I20260807 20:21:21.008074 27459 ts_manager.cc:194] Registered new tserver with Master: 05337dce0ad244dea06ded107fcc9f20 (127.30.35.194:40333)
I20260807 20:21:21.008414 27459 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.35.194:52093
I20260807 20:21:21.009377 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 27722
I20260807 20:21:21.009469 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:21:21.009635 30863 external_mini_cluster.cc:1428] Setting key 0e05853aea15b40a231664247895a94c
I20260807 20:21:21.010525 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:42883
--builtin_ntp_servers=127.30.35.212:33331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 20:21:21.093008 27920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:21.093225 27920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:21.093253 27920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:21.094472 27920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:21.094516 27920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:21.094549 27920 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:21:21.095935 27920 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:42883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:21.096194 27920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:21.096485 27920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:21.101428 27927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:21.101454 27926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:21.101449 27931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:21.101675 27920 server_base.cc:1034] running on GCE node
I20260807 20:21:21.101893 27920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:21.102118 27920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:21.103279 27920 hybrid_clock.cc:648] HybridClock initialized: now 1786134081103261 us; error 35 us; skew 500 ppm
I20260807 20:21:21.104595 27920 webserver.cc:460] Webserver started at http://127.30.35.195:33549/ using document root <none> and password file <none>
I20260807 20:21:21.104866 27920 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:21.104918 27920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:21.105057 27920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:21.106242 27920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "c41c4bbe4e8e42c9aa171757f99c67b8"
format_stamp: "Formatted at 2026-08-07 20:21:21 on dist-test-slave-t7g5"
server_key: "135ae301fcefc0c528234eb9d6fbf0cb"
server_key_iv: "43d523461ce3df0438ec3dd409d938d1"
server_key_version: "encryptionkey@0"
I20260807 20:21:21.106566 27920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "c41c4bbe4e8e42c9aa171757f99c67b8"
format_stamp: "Formatted at 2026-08-07 20:21:21 on dist-test-slave-t7g5"
server_key: "135ae301fcefc0c528234eb9d6fbf0cb"
server_key_iv: "43d523461ce3df0438ec3dd409d938d1"
server_key_version: "encryptionkey@0"
I20260807 20:21:21.108091 27920 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:21:21.108837 27940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:21.108996 27920 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:21.109082 27920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "c41c4bbe4e8e42c9aa171757f99c67b8"
format_stamp: "Formatted at 2026-08-07 20:21:21 on dist-test-slave-t7g5"
server_key: "135ae301fcefc0c528234eb9d6fbf0cb"
server_key_iv: "43d523461ce3df0438ec3dd409d938d1"
server_key_version: "encryptionkey@0"
I20260807 20:21:21.109145 27920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:21.117967 27920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:21.118263 27920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:21.118392 27920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:21.118598 27920 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:21.118923 27920 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:21.118960 27920 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:21.118989 27920 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:21.119005 27920 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:21.124447 27920 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:35127
I20260807 20:21:21.124490 28106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:35127 every 8 connection(s)
I20260807 20:21:21.124816 27920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:21:21.125792 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 27920
I20260807 20:21:21.125905 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:21:21.126127 30863 external_mini_cluster.cc:1428] Setting key 3970c92bd6c5eaef02096493fcd1dae1
I20260807 20:21:21.130307 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.125500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:35637 (local address 127.30.35.254:42883)
0807 20:21:21.125621 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:21.125623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:21.125860 (+ 237us) server_negotiation.cc:407] Connection header received
0807 20:21:21.126539 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:21.126540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:21.126553 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:21.126611 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:21.127446 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.127943 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.128906 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.129097 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.129163 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.130023 (+ 860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:21.130024 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:21.130025 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:21.130029 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:21.130044 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:21.130048 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:21.130092 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:21.130216 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 20:21:21.130242 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 20:21:21.130421 28109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.125476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:42883 (local address 127.30.35.195:35637)
0807 20:21:21.125710 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:21.125760 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:21.126433 (+ 673us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:21.126693 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:21.126697 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:21.126708 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:21.127349 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:21.127355 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.128015 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.128016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:21.128804 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:21.128806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.129171 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.129172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:21.129286 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.129848 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:21:21.129848 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:21.129905 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:21:21.129930 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:21.130099 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:21.130101 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:21.130109 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 20:21:21.130157 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 20:21:21.130248 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
I20260807 20:21:21.130877 28107 heartbeater.cc:347] Connected to a master server at 127.30.35.254:42883
I20260807 20:21:21.130977 28107 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:21.131161 28107 heartbeater.cc:511] Master 127.30.35.254:42883 requested a full tablet report, sending...
I20260807 20:21:21.131536 27459 ts_manager.cc:194] Registered new tserver with Master: c41c4bbe4e8e42c9aa171757f99c67b8 (127.30.35.195:35127)
I20260807 20:21:21.131884 27459 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.35.195:35637
I20260807 20:21:21.138048 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:21:21.142354 27505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.139402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46918 (local address 127.30.35.254:42883)
0807 20:21:21.139448 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:21.139450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:21.139550 (+ 100us) server_negotiation.cc:407] Connection header received
0807 20:21:21.139616 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:21.139617 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:21.139628 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:21.139673 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:21.139868 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.140346 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.141076 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.141255 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.141316 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.142071 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:21.142073 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:21.142073 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:21.142078 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:21.142093 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:21.142096 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:21.142182 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:21.142255 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 20:21:21.142265 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:21:21.144037 27459 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46918:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:21:21.145574 27459 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:21:21.151620 28118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.147750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:35127 (local address 127.0.0.1:48042)
0807 20:21:21.147921 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:21.147967 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:21.148036 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:21.148324 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:21.148327 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:21.148329 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:21.148396 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:21.148398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.149408 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.149409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:21.150462 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:21.150465 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.151337 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.151338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:21.151412 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.151425 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 20:21:21.151495 (+ 70us) client_negotiation.cc:240] Negotiation successful
0807 20:21:21.151545 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":85,"threads_started":1}
I20260807 20:21:21.151633 28125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.148013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48042 (local address 127.30.35.195:35127)
0807 20:21:21.148171 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:21.148176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:21.148186 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:21:21.148221 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:21.148222 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:21.148235 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:21.148308 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:21.148479 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.149340 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.150560 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.151274 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.151339 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.151448 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:21.151509 (+ 61us) server_negotiation.cc:299] Negotiation successful
0807 20:21:21.151545 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":74,"threads_started":1}
I20260807 20:21:21.152205 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.148262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45420 (local address 127.30.35.194:40333)
0807 20:21:21.148451 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:21.148455 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:21.148573 (+ 118us) server_negotiation.cc:407] Connection header received
0807 20:21:21.148621 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:21.148624 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:21.148639 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:21.148709 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:21.148899 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.149995 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.150987 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.151717 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.151799 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.151885 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:21.152062 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 20:21:21.152121 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":80,"threads_started":1}
I20260807 20:21:21.152251 28121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.147750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:43469 (local address 127.0.0.1:34326)
0807 20:21:21.148137 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:21.148146 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:21.148192 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:21.148639 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:21.148640 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:21.148642 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:21.148686 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:21.148687 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.150029 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.150030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:21.151073 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:21.151076 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.151922 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.151923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:21.151991 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.152000 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 20:21:21.152053 (+ 53us) client_negotiation.cc:240] Negotiation successful
0807 20:21:21.152165 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"mutex_wait_us":5,"thread_start_us":85,"threads_started":1}
I20260807 20:21:21.152244 28123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.147784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:40333 (local address 127.0.0.1:45420)
0807 20:21:21.148502 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:21.148511 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:21.148566 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:21.148781 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:21.148782 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:21.148784 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:21.148822 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:21.148823 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.150053 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.150054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:21.150916 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:21.150918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.151923 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.151924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:21.151991 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.151996 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:21:21.152046 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 20:21:21.152144 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":703,"mutex_wait_us":58,"thread_start_us":107,"threads_started":1}
I20260807 20:21:21.152410 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.148044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34326 (local address 127.30.35.193:43469)
0807 20:21:21.148312 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:21.148318 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:21.148329 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:21:21.148368 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:21.148370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:21.148394 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:21.148771 (+ 377us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:21.148819 (+ 48us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.149942 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.151159 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.151845 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.151910 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.151988 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:21.152290 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 20:21:21.152329 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":92,"threads_started":1}
I20260807 20:21:21.152670 28002 tablet_service.cc:1467] Processing CreateTablet for tablet 9e08214b3b654a6f9e71d5ed8175d35e (DEFAULT_TABLE table=test-table [id=a13ce580b09f4b29b1cc4b324d3d3886]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:21.153072 28002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e08214b3b654a6f9e71d5ed8175d35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:21.153040 27815 tablet_service.cc:1467] Processing CreateTablet for tablet 9e08214b3b654a6f9e71d5ed8175d35e (DEFAULT_TABLE table=test-table [id=a13ce580b09f4b29b1cc4b324d3d3886]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:21.153407 27815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e08214b3b654a6f9e71d5ed8175d35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:21.156508 28128 tablet_bootstrap.cc:492] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20: Bootstrap starting.
I20260807 20:21:21.156847 27622 tablet_service.cc:1467] Processing CreateTablet for tablet 9e08214b3b654a6f9e71d5ed8175d35e (DEFAULT_TABLE table=test-table [id=a13ce580b09f4b29b1cc4b324d3d3886]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:21.157140 27622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e08214b3b654a6f9e71d5ed8175d35e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:21.157208 28128 tablet_bootstrap.cc:654] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:21.157474 28128 log.cc:824] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:21.157800 28133 tablet_bootstrap.cc:492] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8: Bootstrap starting.
I20260807 20:21:21.158303 28128 tablet_bootstrap.cc:492] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20: No bootstrap required, opened a new log
I20260807 20:21:21.158380 28128 ts_tablet_manager.cc:1397] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:21:21.158444 28133 tablet_bootstrap.cc:654] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:21.158751 28133 log.cc:824] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:21.159700 28133 tablet_bootstrap.cc:492] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8: No bootstrap required, opened a new log
I20260807 20:21:21.159813 28133 ts_tablet_manager.cc:1397] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:21:21.160059 28137 tablet_bootstrap.cc:492] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c: Bootstrap starting.
I20260807 20:21:21.160725 28137 tablet_bootstrap.cc:654] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:21.160667 28128 raft_consensus.cc:348] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96bc242e2544d2485585c14c5af385c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 43469 } } peers { permanent_uuid: "c41c4bbe4e8e42c9aa171757f99c67b8" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35127 } } peers { permanent_uuid: "05337dce0ad244dea06ded107fcc9f20" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40333 } }
I20260807 20:21:21.160853 28128 raft_consensus.cc:374] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:21.160902 28128 raft_consensus.cc:729] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05337dce0ad244dea06ded107fcc9f20, State: Initialized, Role: FOLLOWER
I20260807 20:21:21.161032 28137 log.cc:824] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:21.161027 28128 consensus_queue.cc:260] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96bc242e2544d2485585c14c5af385c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 43469 } } peers { permanent_uuid: "c41c4bbe4e8e42c9aa171757f99c67b8" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35127 } } peers { permanent_uuid: "05337dce0ad244dea06ded107fcc9f20" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40333 } }
I20260807 20:21:21.161278 28128 ts_tablet_manager.cc:1428] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:21:21.161350 27913 heartbeater.cc:503] Master 127.30.35.254:42883 was elected leader, sending a full tablet report...
I20260807 20:21:21.162099 28133 raft_consensus.cc:348] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96bc242e2544d2485585c14c5af385c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 43469 } } peers { permanent_uuid: "c41c4bbe4e8e42c9aa171757f99c67b8" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35127 } } peers { permanent_uuid: "05337dce0ad244dea06ded107fcc9f20" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40333 } }
I20260807 20:21:21.162235 28137 tablet_bootstrap.cc:492] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c: No bootstrap required, opened a new log
I20260807 20:21:21.162261 28133 raft_consensus.cc:374] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:21.162294 28137 ts_tablet_manager.cc:1397] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:21:21.162305 28133 raft_consensus.cc:729] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c41c4bbe4e8e42c9aa171757f99c67b8, State: Initialized, Role: FOLLOWER
I20260807 20:21:21.162411 28133 consensus_queue.cc:260] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96bc242e2544d2485585c14c5af385c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 43469 } } peers { permanent_uuid: "c41c4bbe4e8e42c9aa171757f99c67b8" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35127 } } peers { permanent_uuid: "05337dce0ad244dea06ded107fcc9f20" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40333 } }
I20260807 20:21:21.162655 28133 ts_tablet_manager.cc:1428] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:21:21.162737 28107 heartbeater.cc:503] Master 127.30.35.254:42883 was elected leader, sending a full tablet report...
I20260807 20:21:21.164251 28137 raft_consensus.cc:348] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96bc242e2544d2485585c14c5af385c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 43469 } } peers { permanent_uuid: "c41c4bbe4e8e42c9aa171757f99c67b8" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35127 } } peers { permanent_uuid: "05337dce0ad244dea06ded107fcc9f20" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40333 } }
I20260807 20:21:21.164383 28137 raft_consensus.cc:374] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:21.164405 28137 raft_consensus.cc:729] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a96bc242e2544d2485585c14c5af385c, State: Initialized, Role: FOLLOWER
I20260807 20:21:21.164489 28137 consensus_queue.cc:260] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96bc242e2544d2485585c14c5af385c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 43469 } } peers { permanent_uuid: "c41c4bbe4e8e42c9aa171757f99c67b8" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35127 } } peers { permanent_uuid: "05337dce0ad244dea06ded107fcc9f20" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40333 } }
I20260807 20:21:21.164701 28137 ts_tablet_manager.cc:1428] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 20:21:21.164767 27716 heartbeater.cc:503] Master 127.30.35.254:42883 was elected leader, sending a full tablet report...
W20260807 20:21:21.252027 27916 tablet.cc:2369] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:21:21.321210 28140 raft_consensus.cc:482] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:21:21.321362 28140 raft_consensus.cc:504] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96bc242e2544d2485585c14c5af385c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 43469 } } peers { permanent_uuid: "c41c4bbe4e8e42c9aa171757f99c67b8" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35127 } } peers { permanent_uuid: "05337dce0ad244dea06ded107fcc9f20" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40333 } }
I20260807 20:21:21.321722 28140 leader_election.cc:288] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a96bc242e2544d2485585c14c5af385c (127.30.35.193:43469), c41c4bbe4e8e42c9aa171757f99c67b8 (127.30.35.195:35127)
I20260807 20:21:21.325568 28125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.322053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:33077 (local address 127.30.35.195:35127)
0807 20:21:21.322102 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:21.322104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:21.322116 (+ 12us) server_negotiation.cc:407] Connection header received
0807 20:21:21.322149 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:21.322150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:21.322157 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:21.322216 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:21.322383 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.323157 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.324601 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.325175 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.325238 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.325247 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:21.325445 (+ 198us) server_negotiation.cc:299] Negotiation successful
0807 20:21:21.325493 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260807 20:21:21.325568 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.322039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:48507 (local address 127.30.35.193:43469)
0807 20:21:21.322085 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:21.322087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:21.322266 (+ 179us) server_negotiation.cc:407] Connection header received
0807 20:21:21.322293 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:21.322294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:21.322303 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:21.322361 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:21.322488 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.323164 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.324601 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.325153 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.325238 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.325247 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:21.325444 (+ 197us) server_negotiation.cc:299] Negotiation successful
0807 20:21:21.325493 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 20:21:21.325569 27919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.321978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:35127 (local address 127.30.35.194:33077)
0807 20:21:21.322033 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:21.322045 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:21.322092 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:21.322229 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:21.322230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:21.322232 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:21.322312 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:21.322314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.323238 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.323239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:21.324500 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:21.324504 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.325242 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.325243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:21.325330 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.325334 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:21:21.325386 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 20:21:21.325435 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":9}
I20260807 20:21:21.325577 28146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.321985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:43469 (local address 127.30.35.194:48507)
0807 20:21:21.322194 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:21.322202 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:21.322248 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:21.322370 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:21.322370 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:21.322372 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:21.322426 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:21.322428 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.323237 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.323237 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:21.324500 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:21.324504 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.325255 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.325256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:21.325330 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.325334 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:21:21.325386 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 20:21:21.325432 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":111,"thread_start_us":104,"threads_started":1}
I20260807 20:21:21.325979 28040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e08214b3b654a6f9e71d5ed8175d35e" candidate_uuid: "05337dce0ad244dea06ded107fcc9f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41c4bbe4e8e42c9aa171757f99c67b8" is_pre_election: true
I20260807 20:21:21.325992 27651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e08214b3b654a6f9e71d5ed8175d35e" candidate_uuid: "05337dce0ad244dea06ded107fcc9f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96bc242e2544d2485585c14c5af385c" is_pre_election: true
I20260807 20:21:21.326133 28040 raft_consensus.cc:2454] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05337dce0ad244dea06ded107fcc9f20 in term 0.
I20260807 20:21:21.326135 27651 raft_consensus.cc:2454] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05337dce0ad244dea06ded107fcc9f20 in term 0.
I20260807 20:21:21.326364 27745 leader_election.cc:302] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 05337dce0ad244dea06ded107fcc9f20, a96bc242e2544d2485585c14c5af385c, c41c4bbe4e8e42c9aa171757f99c67b8; no voters:
I20260807 20:21:21.326516 28140 raft_consensus.cc:2781] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:21:21.326589 28140 raft_consensus.cc:482] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:21:21.326613 28140 raft_consensus.cc:3037] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:21.327317 28140 raft_consensus.cc:504] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96bc242e2544d2485585c14c5af385c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 43469 } } peers { permanent_uuid: "c41c4bbe4e8e42c9aa171757f99c67b8" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35127 } } peers { permanent_uuid: "05337dce0ad244dea06ded107fcc9f20" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40333 } }
I20260807 20:21:21.327448 28140 leader_election.cc:288] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [CANDIDATE]: Term 1 election: Requested vote from peers a96bc242e2544d2485585c14c5af385c (127.30.35.193:43469), c41c4bbe4e8e42c9aa171757f99c67b8 (127.30.35.195:35127)
I20260807 20:21:21.327587 27651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e08214b3b654a6f9e71d5ed8175d35e" candidate_uuid: "05337dce0ad244dea06ded107fcc9f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a96bc242e2544d2485585c14c5af385c"
I20260807 20:21:21.327598 28040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e08214b3b654a6f9e71d5ed8175d35e" candidate_uuid: "05337dce0ad244dea06ded107fcc9f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c41c4bbe4e8e42c9aa171757f99c67b8"
I20260807 20:21:21.327663 27651 raft_consensus.cc:3037] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:21.327666 28040 raft_consensus.cc:3037] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:21.328510 28040 raft_consensus.cc:2454] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05337dce0ad244dea06ded107fcc9f20 in term 1.
I20260807 20:21:21.328541 27651 raft_consensus.cc:2454] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05337dce0ad244dea06ded107fcc9f20 in term 1.
I20260807 20:21:21.328668 27751 leader_election.cc:302] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05337dce0ad244dea06ded107fcc9f20, c41c4bbe4e8e42c9aa171757f99c67b8; no voters:
I20260807 20:21:21.328759 28140 raft_consensus.cc:2781] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:21.328907 28140 raft_consensus.cc:686] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [term 1 LEADER]: Becoming Leader. State: Replica: 05337dce0ad244dea06ded107fcc9f20, State: Running, Role: LEADER
I20260807 20:21:21.329000 28140 consensus_queue.cc:237] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96bc242e2544d2485585c14c5af385c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 43469 } } peers { permanent_uuid: "c41c4bbe4e8e42c9aa171757f99c67b8" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35127 } } peers { permanent_uuid: "05337dce0ad244dea06ded107fcc9f20" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40333 } }
I20260807 20:21:21.329793 27459 catalog_manager.cc:5495] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05337dce0ad244dea06ded107fcc9f20 (127.30.35.194). New cstate: current_term: 1 leader_uuid: "05337dce0ad244dea06ded107fcc9f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a96bc242e2544d2485585c14c5af385c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 43469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c41c4bbe4e8e42c9aa171757f99c67b8" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05337dce0ad244dea06ded107fcc9f20" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 40333 } health_report { overall_health: HEALTHY } } }
W20260807 20:21:21.367981 27719 tablet.cc:2369] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:21:21.375303 28108 tablet.cc:2369] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:21:21.376965 28127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.374836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45424 (local address 127.30.35.194:40333)
0807 20:21:21.374904 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:21.374906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:21.374915 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:21:21.374952 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:21.374953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:21.374972 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:21.375033 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:21.375134 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.375650 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.376376 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:21.376552 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:21.376593 (+ 41us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:21.376694 (+ 101us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:21.376778 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:21.376841 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:21.376882 (+ 41us) server_negotiation.cc:299] Negotiation successful
0807 20:21:21.376890 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 20:21:21.378710 28040 raft_consensus.cc:1261] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8 [term 1 FOLLOWER]: Refusing update from remote peer 05337dce0ad244dea06ded107fcc9f20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:21.378711 27651 raft_consensus.cc:1261] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c [term 1 FOLLOWER]: Refusing update from remote peer 05337dce0ad244dea06ded107fcc9f20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:21.379015 28140 consensus_queue.cc:1035] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a96bc242e2544d2485585c14c5af385c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 43469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:21.379166 28147 consensus_queue.cc:1035] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c41c4bbe4e8e42c9aa171757f99c67b8" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 35127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:21.382170 28155 mvcc.cc:205] Tried to move back new op lower bound from 7316005197324611584 to 7316005197124149248. Current Snapshot: MvccSnapshot[applied={T|T < 7316005197324611584}]
I20260807 20:21:21.384364 27458 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:21:21.384447 27458 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:21:21.385159 27458 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac7194e040fb457f83a050538cc3af69: Sending DeleteTablet for 3 replicas of tablet 9e08214b3b654a6f9e71d5ed8175d35e
I20260807 20:21:21.385449 27622 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e08214b3b654a6f9e71d5ed8175d35e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:21 UTC) from {username='slave'} at 127.0.0.1:34326
I20260807 20:21:21.385530 27815 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e08214b3b654a6f9e71d5ed8175d35e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:21 UTC) from {username='slave'} at 127.0.0.1:45420
I20260807 20:21:21.385690 28168 tablet_replica.cc:330] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c: stopping tablet replica
I20260807 20:21:21.385802 28168 raft_consensus.cc:2229] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:21:21.385774 28002 tablet_service.cc:1514] Processing DeleteTablet for tablet 9e08214b3b654a6f9e71d5ed8175d35e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:21 UTC) from {username='slave'} at 127.0.0.1:48042
I20260807 20:21:21.385915 28168 raft_consensus.cc:2258] T 9e08214b3b654a6f9e71d5ed8175d35e P a96bc242e2544d2485585c14c5af385c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:21:21.386255 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 27534
I20260807 20:21:21.386392 28170 tablet_replica.cc:330] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8: stopping tablet replica
I20260807 20:21:21.386549 28170 raft_consensus.cc:2229] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:21:21.388828 28170 raft_consensus.cc:2258] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:21:21.392637 28170 ts_tablet_manager.cc:1905] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:21:21.394948 28170 ts_tablet_manager.cc:1918] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:21:21.395025 28170 log.cc:1196] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/9e08214b3b654a6f9e71d5ed8175d35e
I20260807 20:21:21.395224 28170 ts_tablet_manager.cc:1939] T 9e08214b3b654a6f9e71d5ed8175d35e P c41c4bbe4e8e42c9aa171757f99c67b8: Deleting consensus metadata
I20260807 20:21:21.396682 27439 catalog_manager.cc:4841] TS c41c4bbe4e8e42c9aa171757f99c67b8 (127.30.35.195:35127): tablet 9e08214b3b654a6f9e71d5ed8175d35e (table test-table [id=a13ce580b09f4b29b1cc4b324d3d3886]) successfully deleted
I20260807 20:21:21.396991 28169 tablet_replica.cc:330] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20: stopping tablet replica
I20260807 20:21:21.397122 28169 raft_consensus.cc:2229] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [term 1 LEADER]: Raft consensus shutting down.
I20260807 20:21:21.397266 28169 raft_consensus.cc:2258] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:21:21.397718 28169 ts_tablet_manager.cc:1905] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:21:21.399487 28169 ts_tablet_manager.cc:1918] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:21:21.399566 28169 log.cc:1196] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/9e08214b3b654a6f9e71d5ed8175d35e
I20260807 20:21:21.399786 28169 ts_tablet_manager.cc:1939] T 9e08214b3b654a6f9e71d5ed8175d35e P 05337dce0ad244dea06ded107fcc9f20: Deleting consensus metadata
I20260807 20:21:21.400486 27437 catalog_manager.cc:4841] TS 05337dce0ad244dea06ded107fcc9f20 (127.30.35.194:40333): tablet 9e08214b3b654a6f9e71d5ed8175d35e (table test-table [id=a13ce580b09f4b29b1cc4b324d3d3886]) successfully deleted
W20260807 20:21:21.400938 27436 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:43469 (error 108)
I20260807 20:21:21.401232 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 27722
I20260807 20:21:21.412127 28118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:21.411954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:43469 (local address 127.0.0.1:34328)
0807 20:21:21.412021 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:21.412086 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:43469: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260807 20:21:21.412273 27436 catalog_manager.cc:4584] TS a96bc242e2544d2485585c14c5af385c (127.30.35.193:43469): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9e08214b3b654a6f9e71d5ed8175d35e: Network error: Client connection negotiation failed: client connection to 127.30.35.193:43469: connect: Connection refused (error 111)
I20260807 20:21:21.415876 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 27920
I20260807 20:21:21.425495 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 27415
2026-08-07T20:21:21Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (871 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:21 dist-test-slave-t7g5 krb5kdc[28174](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:21 dist-test-slave-t7g5 krb5kdc[28174](info): set up 2 sockets
Aug 07 20:21:21 dist-test-slave-t7g5 krb5kdc[28174](info): commencing operation
krb5kdc: starting...
W20260807 20:21:22.575167 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:22 dist-test-slave-t7g5 krb5kdc[28174](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:21:22.692775 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:34809
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:43579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:34809
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:22.775352 28193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:22.775592 28193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:22.775625 28193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:22.777078 28193 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:22.777129 28193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:22.777148 28193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:22.777163 28193 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:22.777179 28193 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:22.778736 28193 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:43579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:34809
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:34809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:22.779007 28193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:22.779219 28193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:22.784070 28204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:22.784046 28208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:22.784063 28193 server_base.cc:1034] running on GCE node
W20260807 20:21:22.784039 28205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:22.784596 28193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:22.784901 28193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:22.786041 28193 hybrid_clock.cc:648] HybridClock initialized: now 1786134082786023 us; error 35 us; skew 500 ppm
Aug 07 20:21:22 dist-test-slave-t7g5 krb5kdc[28174](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134082, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:22.793118 28193 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:21:22.793581 28193 webserver.cc:460] Webserver started at http://127.30.35.254:38275/ using document root <none> and password file <none>
I20260807 20:21:22.793841 28193 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:22.793895 28193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:22.794019 28193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:22.795073 28193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "a67bdee4659546e08764dc37d1d0fce0"
format_stamp: "Formatted at 2026-08-07 20:21:22 on dist-test-slave-t7g5"
server_key: "f319622a04baee65f732192840d19cc7"
server_key_iv: "3bfdaf44aa80bac7e5871aef7e7bdd01"
server_key_version: "encryptionkey@0"
I20260807 20:21:22.795429 28193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "a67bdee4659546e08764dc37d1d0fce0"
format_stamp: "Formatted at 2026-08-07 20:21:22 on dist-test-slave-t7g5"
server_key: "f319622a04baee65f732192840d19cc7"
server_key_iv: "3bfdaf44aa80bac7e5871aef7e7bdd01"
server_key_version: "encryptionkey@0"
I20260807 20:21:22.796695 28193 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:21:22.797410 28224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:22.797605 28193 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:21:22.797734 28193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "a67bdee4659546e08764dc37d1d0fce0"
format_stamp: "Formatted at 2026-08-07 20:21:22 on dist-test-slave-t7g5"
server_key: "f319622a04baee65f732192840d19cc7"
server_key_iv: "3bfdaf44aa80bac7e5871aef7e7bdd01"
server_key_version: "encryptionkey@0"
I20260807 20:21:22.797806 28193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:22.809875 28193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:22.812093 28193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:22.812245 28193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:22.816332 28193 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:34809
I20260807 20:21:22.816368 28313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:34809 every 8 connection(s)
I20260807 20:21:22.816737 28193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:22.817564 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 28193
I20260807 20:21:22.817709 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:22.817749 28315 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:22.817950 30863 external_mini_cluster.cc:1428] Setting key d93348002e90c44fdd1833026afbb6ed
I20260807 20:21:22.820946 28315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0: Bootstrap starting.
I20260807 20:21:22.821777 28315 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:22.822077 28315 log.cc:824] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:22.822742 28315 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0: No bootstrap required, opened a new log
Aug 07 20:21:22 dist-test-slave-t7g5 krb5kdc[28174](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134082, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:22.824762 28315 raft_consensus.cc:348] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67bdee4659546e08764dc37d1d0fce0" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34809 } }
I20260807 20:21:22.824947 28315 raft_consensus.cc:374] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:22.825002 28315 raft_consensus.cc:729] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a67bdee4659546e08764dc37d1d0fce0, State: Initialized, Role: FOLLOWER
I20260807 20:21:22.825136 28315 consensus_queue.cc:260] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67bdee4659546e08764dc37d1d0fce0" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34809 } }
I20260807 20:21:22.825201 28315 raft_consensus.cc:388] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:22.825222 28315 raft_consensus.cc:482] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:22.825268 28315 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:22.825877 28315 raft_consensus.cc:504] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67bdee4659546e08764dc37d1d0fce0" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34809 } }
I20260807 20:21:22.825986 28315 leader_election.cc:302] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a67bdee4659546e08764dc37d1d0fce0; no voters:
I20260807 20:21:22.826150 28315 leader_election.cc:288] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:22.826404 28315 sys_catalog.cc:564] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:22.826206 28322 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:22.826663 28322 raft_consensus.cc:686] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [term 1 LEADER]: Becoming Leader. State: Replica: a67bdee4659546e08764dc37d1d0fce0, State: Running, Role: LEADER
I20260807 20:21:22.826752 28322 consensus_queue.cc:237] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67bdee4659546e08764dc37d1d0fce0" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34809 } }
I20260807 20:21:22.827072 28323 sys_catalog.cc:455] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a67bdee4659546e08764dc37d1d0fce0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67bdee4659546e08764dc37d1d0fce0" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34809 } } }
I20260807 20:21:22.827147 28323 sys_catalog.cc:458] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:22.827309 28325 sys_catalog.cc:455] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a67bdee4659546e08764dc37d1d0fce0. Latest consensus state: current_term: 1 leader_uuid: "a67bdee4659546e08764dc37d1d0fce0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a67bdee4659546e08764dc37d1d0fce0" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34809 } } }
I20260807 20:21:22.827346 28332 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:22.827378 28325 sys_catalog.cc:458] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:22.828195 28332 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:22.829316 28318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:22.818525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37846 (local address 127.30.35.254:34809)
0807 20:21:22.818712 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:22.818720 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:22.818746 (+ 26us) server_negotiation.cc:407] Connection header received
0807 20:21:22.819215 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:22.819222 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:22.819271 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:22.819392 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:22.820181 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:22.821309 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:22.822275 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:22.822705 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:22.822805 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:22.825416 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:22.825420 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:22.825420 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:22.825433 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:22.827413 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:22.827825 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:22.827828 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:22.827829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:22.827950 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:22.828156 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:22.828158 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:22.828158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:22.828504 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:22.828659 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:22.829008 (+ 349us) server_negotiation.cc:299] Negotiation successful
0807 20:21:22.829148 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":135,"thread_start_us":71,"threads_started":1}
I20260807 20:21:22.829818 28332 catalog_manager.cc:1347] Generated new cluster ID: bd89cbad445144c3b4f96a0bcd4d2bce
I20260807 20:21:22.829867 28332 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:22.840107 28332 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:22.840855 28332 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:22.846540 28332 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0: Generated new TSK 0
I20260807 20:21:22.846727 28332 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.30.35.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
Entry for principal kudu/127.30.35.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab.
I20260807 20:21:22.880369 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34809
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:43579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:22.969879 28352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:22.970127 28352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:22.970153 28352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:22.971310 28352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:22.971356 28352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:22.971383 28352 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:21:22.972842 28352 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:43579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.193.keytab
--principal=kudu/127.30.35.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:22.973079 28352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:22.973320 28352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:22.978308 28364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:22.978375 28367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:22.978447 28352 server_base.cc:1034] running on GCE node
W20260807 20:21:22.978569 28369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:22.978828 28352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:22.979067 28352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:22.980237 28352 hybrid_clock.cc:648] HybridClock initialized: now 1786134082980219 us; error 34 us; skew 500 ppm
Aug 07 20:21:22 dist-test-slave-t7g5 krb5kdc[28174](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134082, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:22.982784 28352 init.cc:377] Logged in from keytab as kudu/127.30.35.193@KRBTEST.COM (short username kudu)
I20260807 20:21:22.983207 28352 webserver.cc:460] Webserver started at http://127.30.35.193:40645/ using document root <none> and password file <none>
I20260807 20:21:22.983419 28352 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:22.983466 28352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:22.983603 28352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:22.984789 28352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "ef60bb8f87eb4642acdf612cc0233e72"
format_stamp: "Formatted at 2026-08-07 20:21:22 on dist-test-slave-t7g5"
server_key: "03d4f1e53fed8db92b24ec6ba6345428"
server_key_iv: "22f0828f4f9087bd49ea4f6e432b748a"
server_key_version: "encryptionkey@0"
I20260807 20:21:22.985139 28352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "ef60bb8f87eb4642acdf612cc0233e72"
format_stamp: "Formatted at 2026-08-07 20:21:22 on dist-test-slave-t7g5"
server_key: "03d4f1e53fed8db92b24ec6ba6345428"
server_key_iv: "22f0828f4f9087bd49ea4f6e432b748a"
server_key_version: "encryptionkey@0"
I20260807 20:21:22.986538 28352 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260807 20:21:22.987243 28376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:22.987383 28352 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:22.987462 28352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "ef60bb8f87eb4642acdf612cc0233e72"
format_stamp: "Formatted at 2026-08-07 20:21:22 on dist-test-slave-t7g5"
server_key: "03d4f1e53fed8db92b24ec6ba6345428"
server_key_iv: "22f0828f4f9087bd49ea4f6e432b748a"
server_key_version: "encryptionkey@0"
I20260807 20:21:22.987528 28352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:23.012137 28352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:23.014561 28352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:23.014725 28352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:23.014950 28352 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:23.015244 28352 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:23.015275 28352 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.015301 28352 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:23.015317 28352 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.020853 28352 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:34369
I20260807 20:21:23.020947 28543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:34369 every 8 connection(s)
I20260807 20:21:23.021220 28352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:21:23.026916 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 28352
I20260807 20:21:23.027045 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:21:23.027297 30863 external_mini_cluster.cc:1428] Setting key 29fedbcf15c7a793010ec6418c1e7e02
Aug 07 20:21:23 dist-test-slave-t7g5 krb5kdc[28174](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134082, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.193@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:23.030740 28318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.021984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:46783 (local address 127.30.35.254:34809)
0807 20:21:23.022049 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:23.022051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:23.022257 (+ 206us) server_negotiation.cc:407] Connection header received
0807 20:21:23.022723 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:23.022725 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:23.022736 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:23.022794 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:23.023708 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.024209 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.025198 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.025382 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.025425 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.027943 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:23.027944 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:23.027944 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:23.027952 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:23.029294 (+ 1342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:23.029805 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:23.029807 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:23.029807 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:23.029875 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:23.030109 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:23.030110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:23.030110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:23.030250 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:23.030310 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:23.030547 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 20:21:23.030642 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260807 20:21:23.030818 28547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.021936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34809 (local address 127.30.35.193:46783)
0807 20:21:23.022104 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:23.022147 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:23.022642 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:23.022854 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:23.022857 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:23.023435 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:23.023636 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.023641 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.024289 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.024290 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.025135 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.025137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.025451 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.025452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.025560 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.026101 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:23.026110 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:23.027824 (+ 1714us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:23.029372 (+ 1548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:23.029380 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:23.029383 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:23.029726 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:23.029942 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:23.029943 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:23.029943 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:23.030054 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:23.030308 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:23.030311 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:23.030436 (+ 125us) client_negotiation.cc:769] Sending connection context
0807 20:21:23.030514 (+ 78us) client_negotiation.cc:240] Negotiation successful
0807 20:21:23.030641 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
I20260807 20:21:23.031266 28544 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34809
I20260807 20:21:23.031360 28544 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:23.031544 28544 heartbeater.cc:511] Master 127.30.35.254:34809 requested a full tablet report, sending...
I20260807 20:21:23.032069 28248 ts_manager.cc:194] Registered new tserver with Master: ef60bb8f87eb4642acdf612cc0233e72 (127.30.35.193:34369)
I20260807 20:21:23.032724 28248 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.193@KRBTEST.COM'} at 127.30.35.193:46783
WARNING: no policy specified for kudu/127.30.35.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
Entry for principal kudu/127.30.35.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab.
I20260807 20:21:23.052356 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34809
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:43579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:23.134613 28551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:23.134836 28551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:23.134868 28551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:23.136039 28551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:23.136081 28551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:23.136116 28551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:21:23.137550 28551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:43579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.194.keytab
--principal=kudu/127.30.35.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28551
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:23.137812 28551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:23.138046 28551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:23.143049 28562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:23.143059 28557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:23.143280 28551 server_base.cc:1034] running on GCE node
W20260807 20:21:23.143286 28558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:23.143499 28551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:23.143720 28551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:23.144896 28551 hybrid_clock.cc:648] HybridClock initialized: now 1786134083144880 us; error 28 us; skew 500 ppm
Aug 07 20:21:23 dist-test-slave-t7g5 krb5kdc[28174](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134083, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:23.147495 28551 init.cc:377] Logged in from keytab as kudu/127.30.35.194@KRBTEST.COM (short username kudu)
I20260807 20:21:23.147938 28551 webserver.cc:460] Webserver started at http://127.30.35.194:46181/ using document root <none> and password file <none>
I20260807 20:21:23.148149 28551 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:23.148196 28551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:23.148330 28551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:23.149423 28551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "7f1ca26093be4d3aaff8c22a5472ea07"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "84af83eeda5d58323f808d28b1603238"
server_key_iv: "5e2cccdcae044b9c5a533905b05908cd"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.149801 28551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "7f1ca26093be4d3aaff8c22a5472ea07"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "84af83eeda5d58323f808d28b1603238"
server_key_iv: "5e2cccdcae044b9c5a533905b05908cd"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.151084 28551 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:21:23.151764 28574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.151918 28551 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:23.152006 28551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "7f1ca26093be4d3aaff8c22a5472ea07"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "84af83eeda5d58323f808d28b1603238"
server_key_iv: "5e2cccdcae044b9c5a533905b05908cd"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.152076 28551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:23.166893 28551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:23.169162 28551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:23.169312 28551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:23.169544 28551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:23.169924 28551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:23.169965 28551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.169996 28551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:23.170012 28551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.175562 28551 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:35249
I20260807 20:21:23.175607 28739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:35249 every 8 connection(s)
I20260807 20:21:23.175940 28551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:21:23.177987 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 28551
I20260807 20:21:23.178097 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:21:23.178290 30863 external_mini_cluster.cc:1428] Setting key ae85a9c4f077721815aaa7029b4a1812
Aug 07 20:21:23 dist-test-slave-t7g5 krb5kdc[28174](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134083, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.194@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:23.185940 28318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.176640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:51871 (local address 127.30.35.254:34809)
0807 20:21:23.176688 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:23.176689 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:23.176885 (+ 196us) server_negotiation.cc:407] Connection header received
0807 20:21:23.177399 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:23.177401 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:23.177415 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:23.177469 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:23.178580 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.179290 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.180282 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.180544 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.180617 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.183110 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:23.183112 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:23.183112 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:23.183119 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:23.184508 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:23.185006 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:23.185006 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:23.185007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:23.185059 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:23.185318 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:23.185318 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:23.185318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:23.185414 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:23.185457 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:23.185811 (+ 354us) server_negotiation.cc:299] Negotiation successful
0807 20:21:23.185876 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 20:21:23.186219 28743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.176609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34809 (local address 127.30.35.194:51871)
0807 20:21:23.176761 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:23.176800 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:23.177294 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:23.177557 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:23.177561 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:23.178199 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:23.178437 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.178445 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.179390 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.179391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.180199 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.180202 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.180642 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.180644 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.180795 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.181322 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:23.181332 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:23.183005 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:23.184592 (+ 1587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:23.184600 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:23.184603 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:23.184918 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:23.185117 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:23.185117 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:23.185118 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:23.185259 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:23.185467 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:23.185474 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:23.185648 (+ 174us) client_negotiation.cc:769] Sending connection context
0807 20:21:23.185794 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 20:21:23.185987 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
I20260807 20:21:23.186815 28741 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34809
I20260807 20:21:23.186929 28741 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:23.187144 28741 heartbeater.cc:511] Master 127.30.35.254:34809 requested a full tablet report, sending...
I20260807 20:21:23.187544 28248 ts_manager.cc:194] Registered new tserver with Master: 7f1ca26093be4d3aaff8c22a5472ea07 (127.30.35.194:35249)
WARNING: no policy specified for kudu/127.30.35.195@KRBTEST.COM; defaulting to no policy
I20260807 20:21:23.187952 28248 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.194@KRBTEST.COM'} at 127.30.35.194:51871
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
Entry for principal kudu/127.30.35.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab.
I20260807 20:21:23.205003 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34809
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:43579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:23.285833 28748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:23.286044 28748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:23.286077 28748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:23.287209 28748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:23.287251 28748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:23.287285 28748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:21:23.288718 28748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:43579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.195.keytab
--principal=kudu/127.30.35.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:23.288969 28748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:23.289178 28748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:23.294088 28755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:23.294103 28757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:23.294216 28748 server_base.cc:1034] running on GCE node
W20260807 20:21:23.294103 28754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:23.294495 28748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:23.294715 28748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:23.295965 28748 hybrid_clock.cc:648] HybridClock initialized: now 1786134083295951 us; error 32 us; skew 500 ppm
Aug 07 20:21:23 dist-test-slave-t7g5 krb5kdc[28174](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134083, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:23.298561 28748 init.cc:377] Logged in from keytab as kudu/127.30.35.195@KRBTEST.COM (short username kudu)
I20260807 20:21:23.299027 28748 webserver.cc:460] Webserver started at http://127.30.35.195:36529/ using document root <none> and password file <none>
I20260807 20:21:23.299259 28748 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:23.299310 28748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:23.299448 28748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:23.300585 28748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "0758751565ea4f7eb028919b38931ef6"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "a3a86de99b4931c2b192caefc984fb19"
server_key_iv: "3f75670d6ceeff6756600f7ea70031d5"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.300920 28748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "0758751565ea4f7eb028919b38931ef6"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "a3a86de99b4931c2b192caefc984fb19"
server_key_iv: "3f75670d6ceeff6756600f7ea70031d5"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.302307 28748 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:21:23.303048 28769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.303184 28748 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:23.303267 28748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "0758751565ea4f7eb028919b38931ef6"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "a3a86de99b4931c2b192caefc984fb19"
server_key_iv: "3f75670d6ceeff6756600f7ea70031d5"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.303331 28748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:23.320279 28748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:23.322510 28748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:23.322640 28748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:23.322883 28748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:23.323202 28748 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:23.323239 28748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.323264 28748 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:23.323289 28748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.329072 28748 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:44221
I20260807 20:21:23.329125 28936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:44221 every 8 connection(s)
I20260807 20:21:23.329417 28748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:21:23.329960 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 28748
I20260807 20:21:23.330068 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:21:23.330297 30863 external_mini_cluster.cc:1428] Setting key 898247c3b1631be89bb8e0c5e3aed133
Aug 07 20:21:23 dist-test-slave-t7g5 krb5kdc[28174](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134083, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.195@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:23.338039 28318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.330477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:59877 (local address 127.30.35.254:34809)
0807 20:21:23.330542 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:23.330545 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:23.330561 (+ 16us) server_negotiation.cc:407] Connection header received
0807 20:21:23.331120 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:23.331122 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:23.331135 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:23.331188 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:23.332105 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.332603 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.333556 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.333817 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.333873 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.335858 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:23.335859 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:23.335860 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:23.335866 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:23.336972 (+ 1106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:23.337303 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:23.337304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:23.337305 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:23.337350 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:23.337520 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:23.337520 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:23.337520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:23.337611 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:23.337677 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:23.337914 (+ 237us) server_negotiation.cc:299] Negotiation successful
0807 20:21:23.337975 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 20:21:23.338218 28941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.330163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34809 (local address 127.30.35.195:59877)
0807 20:21:23.330354 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:23.330405 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:23.331002 (+ 597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:23.331282 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:23.331286 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:23.331841 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:23.332035 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.332040 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.332680 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.332681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.333482 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.333484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.333877 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.333877 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.333976 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.334439 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:23.334447 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:23.335773 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:23.337031 (+ 1258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:23.337036 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:23.337038 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:23.337237 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:23.337391 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:23.337392 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:23.337392 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:23.337481 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:23.337667 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:23.337672 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:23.337808 (+ 136us) client_negotiation.cc:769] Sending connection context
0807 20:21:23.337893 (+ 85us) client_negotiation.cc:240] Negotiation successful
0807 20:21:23.338010 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":102,"threads_started":1}
I20260807 20:21:23.338654 28938 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34809
I20260807 20:21:23.338742 28938 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:23.338929 28938 heartbeater.cc:511] Master 127.30.35.254:34809 requested a full tablet report, sending...
I20260807 20:21:23.339342 28248 ts_manager.cc:194] Registered new tserver with Master: 0758751565ea4f7eb028919b38931ef6 (127.30.35.195:44221)
I20260807 20:21:23.339795 28248 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.30.35.195@KRBTEST.COM'} at 127.30.35.195:59877
I20260807 20:21:23.342017 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:21:23.348603 28318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.343234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37858 (local address 127.30.35.254:34809)
0807 20:21:23.343286 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:23.343289 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:23.343393 (+ 104us) server_negotiation.cc:407] Connection header received
0807 20:21:23.343453 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:23.343454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:23.343463 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:23.343508 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:23.344005 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.344464 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.345139 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.345336 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.345389 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.346494 (+ 1105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:23.346495 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:23.346496 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:23.346503 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:23.347756 (+ 1253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:23.348028 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:23.348029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:23.348029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:23.348072 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:23.348213 (+ 141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:23.348213 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:23.348213 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:23.348343 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:23.348413 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:23.348484 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 20:21:23.348541 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 20:21:23.349908 28248 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37858:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:21:23.351447 28248 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:21:23.357545 28954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.353574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:44221 (local address 127.0.0.1:40744)
0807 20:21:23.353889 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:23.353898 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:23.353937 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:23.354229 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:23.354230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:23.354233 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:23.354299 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.354300 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.355625 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.355626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.356601 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.356604 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.357266 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.357267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.357343 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.357358 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 20:21:23.357421 (+ 63us) client_negotiation.cc:240] Negotiation successful
0807 20:21:23.357472 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":53,"threads_started":1}
I20260807 20:21:23.357636 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.353714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50764 (local address 127.30.35.194:35249)
0807 20:21:23.353997 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:23.354002 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:23.354011 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:21:23.354047 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:23.354048 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:23.354061 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:23.354124 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:23.354307 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.355204 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.356603 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.357328 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.357400 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.357454 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:23.357513 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 20:21:23.357553 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":87,"threads_started":1}
I20260807 20:21:23.357882 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.353823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40744 (local address 127.30.35.195:44221)
0807 20:21:23.353999 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:23.354003 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:23.354014 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:21:23.354053 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:23.354056 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:23.354071 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:23.354154 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:23.354372 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.355516 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.356678 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.357192 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.357255 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.357323 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:23.357756 (+ 433us) server_negotiation.cc:299] Negotiation successful
0807 20:21:23.357797 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":80,"threads_started":1}
I20260807 20:21:23.357954 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.353864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60854 (local address 127.30.35.193:34369)
0807 20:21:23.354033 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:23.354036 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:23.354190 (+ 154us) server_negotiation.cc:407] Connection header received
0807 20:21:23.354246 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:23.354249 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:23.354263 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:23.354331 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:23.354514 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.355588 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.356806 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.357496 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.357555 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.357603 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:23.357855 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 20:21:23.357886 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":76,"threads_started":1}
I20260807 20:21:23.357959 28955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.353573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:35249 (local address 127.0.0.1:50764)
0807 20:21:23.353757 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:23.353800 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:23.353862 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:23.354140 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:23.354143 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:23.354145 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:23.354224 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.354226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.355305 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.355306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.356520 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.356523 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.357398 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.357399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.357451 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.357453 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 20:21:23.357501 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 20:21:23.357533 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":108,"threads_started":1}
I20260807 20:21:23.358153 28958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.353574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:34369 (local address 127.0.0.1:60854)
0807 20:21:23.354082 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:23.354093 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:23.354140 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:23.354406 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:23.354407 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:23.354409 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:23.354445 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.354446 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.355681 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.355682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.356732 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.356734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.357639 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.357640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.357722 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.357727 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:21:23.357775 (+ 48us) client_negotiation.cc:240] Negotiation successful
0807 20:21:23.357814 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"mutex_wait_us":2,"thread_start_us":108,"threads_started":1}
I20260807 20:21:23.358573 28838 tablet_service.cc:1467] Processing CreateTablet for tablet fd788930d7e348d9af0d989194897507 (DEFAULT_TABLE table=test-table [id=3b18740801664b7f9d7a83d761562dc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:23.358738 28648 tablet_service.cc:1467] Processing CreateTablet for tablet fd788930d7e348d9af0d989194897507 (DEFAULT_TABLE table=test-table [id=3b18740801664b7f9d7a83d761562dc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:23.358794 28450 tablet_service.cc:1467] Processing CreateTablet for tablet fd788930d7e348d9af0d989194897507 (DEFAULT_TABLE table=test-table [id=3b18740801664b7f9d7a83d761562dc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:23.358928 28838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd788930d7e348d9af0d989194897507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:23.359030 28648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd788930d7e348d9af0d989194897507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:23.359046 28450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd788930d7e348d9af0d989194897507. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:23.361603 28964 tablet_bootstrap.cc:492] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72: Bootstrap starting.
I20260807 20:21:23.362089 28965 tablet_bootstrap.cc:492] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6: Bootstrap starting.
I20260807 20:21:23.362224 28964 tablet_bootstrap.cc:654] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:23.362746 28965 tablet_bootstrap.cc:654] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:23.362808 28964 log.cc:824] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:23.363339 28965 log.cc:824] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:23.363636 28964 tablet_bootstrap.cc:492] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72: No bootstrap required, opened a new log
I20260807 20:21:23.363680 28966 tablet_bootstrap.cc:492] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07: Bootstrap starting.
I20260807 20:21:23.363711 28964 ts_tablet_manager.cc:1397] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:21:23.364025 28965 tablet_bootstrap.cc:492] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6: No bootstrap required, opened a new log
I20260807 20:21:23.364090 28965 ts_tablet_manager.cc:1397] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:21:23.364296 28966 tablet_bootstrap.cc:654] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:23.364833 28966 log.cc:824] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:23.365618 28966 tablet_bootstrap.cc:492] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07: No bootstrap required, opened a new log
I20260807 20:21:23.365707 28966 ts_tablet_manager.cc:1397] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260807 20:21:23.365568 28964 raft_consensus.cc:348] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0758751565ea4f7eb028919b38931ef6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 44221 } } peers { permanent_uuid: "7f1ca26093be4d3aaff8c22a5472ea07" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 35249 } } peers { permanent_uuid: "ef60bb8f87eb4642acdf612cc0233e72" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34369 } }
I20260807 20:21:23.365769 28964 raft_consensus.cc:374] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:23.365816 28964 raft_consensus.cc:729] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef60bb8f87eb4642acdf612cc0233e72, State: Initialized, Role: FOLLOWER
I20260807 20:21:23.365789 28965 raft_consensus.cc:348] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0758751565ea4f7eb028919b38931ef6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 44221 } } peers { permanent_uuid: "7f1ca26093be4d3aaff8c22a5472ea07" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 35249 } } peers { permanent_uuid: "ef60bb8f87eb4642acdf612cc0233e72" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34369 } }
I20260807 20:21:23.365962 28965 raft_consensus.cc:374] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:23.365938 28964 consensus_queue.cc:260] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0758751565ea4f7eb028919b38931ef6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 44221 } } peers { permanent_uuid: "7f1ca26093be4d3aaff8c22a5472ea07" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 35249 } } peers { permanent_uuid: "ef60bb8f87eb4642acdf612cc0233e72" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34369 } }
I20260807 20:21:23.366009 28965 raft_consensus.cc:729] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0758751565ea4f7eb028919b38931ef6, State: Initialized, Role: FOLLOWER
I20260807 20:21:23.366124 28965 consensus_queue.cc:260] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0758751565ea4f7eb028919b38931ef6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 44221 } } peers { permanent_uuid: "7f1ca26093be4d3aaff8c22a5472ea07" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 35249 } } peers { permanent_uuid: "ef60bb8f87eb4642acdf612cc0233e72" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34369 } }
I20260807 20:21:23.366215 28964 ts_tablet_manager.cc:1428] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260807 20:21:23.366357 28544 heartbeater.cc:503] Master 127.30.35.254:34809 was elected leader, sending a full tablet report...
I20260807 20:21:23.366394 28965 ts_tablet_manager.cc:1428] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 20:21:23.366510 28938 heartbeater.cc:503] Master 127.30.35.254:34809 was elected leader, sending a full tablet report...
I20260807 20:21:23.367578 28966 raft_consensus.cc:348] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0758751565ea4f7eb028919b38931ef6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 44221 } } peers { permanent_uuid: "7f1ca26093be4d3aaff8c22a5472ea07" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 35249 } } peers { permanent_uuid: "ef60bb8f87eb4642acdf612cc0233e72" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34369 } }
I20260807 20:21:23.367707 28966 raft_consensus.cc:374] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:23.367727 28966 raft_consensus.cc:729] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f1ca26093be4d3aaff8c22a5472ea07, State: Initialized, Role: FOLLOWER
I20260807 20:21:23.367810 28966 consensus_queue.cc:260] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0758751565ea4f7eb028919b38931ef6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 44221 } } peers { permanent_uuid: "7f1ca26093be4d3aaff8c22a5472ea07" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 35249 } } peers { permanent_uuid: "ef60bb8f87eb4642acdf612cc0233e72" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34369 } }
I20260807 20:21:23.367997 28966 ts_tablet_manager.cc:1428] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 20:21:23.368076 28741 heartbeater.cc:503] Master 127.30.35.254:34809 was elected leader, sending a full tablet report...
W20260807 20:21:23.426503 28742 tablet.cc:2369] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:21:23.481105 28970 raft_consensus.cc:482] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:21:23.481247 28970 raft_consensus.cc:504] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0758751565ea4f7eb028919b38931ef6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 44221 } } peers { permanent_uuid: "7f1ca26093be4d3aaff8c22a5472ea07" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 35249 } } peers { permanent_uuid: "ef60bb8f87eb4642acdf612cc0233e72" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34369 } }
I20260807 20:21:23.481688 28970 leader_election.cc:288] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0758751565ea4f7eb028919b38931ef6 (127.30.35.195:44221), 7f1ca26093be4d3aaff8c22a5472ea07 (127.30.35.194:35249)
I20260807 20:21:23.485481 28961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.481931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:38799 (local address 127.30.35.195:44221)
0807 20:21:23.481992 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:23.481993 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:23.482001 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:21:23.482032 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:23.482033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:23.482041 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:23.482105 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:23.482281 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.483018 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.484516 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.485117 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.485201 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.485211 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:23.485370 (+ 159us) server_negotiation.cc:299] Negotiation successful
0807 20:21:23.485411 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 20:21:23.485482 28960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.481937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:42993 (local address 127.30.35.194:35249)
0807 20:21:23.481982 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:23.481984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:23.482168 (+ 184us) server_negotiation.cc:407] Connection header received
0807 20:21:23.482192 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:23.482193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:23.482199 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:23.482238 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:23.482373 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.483077 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.484517 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.485116 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.485202 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.485211 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:23.485363 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 20:21:23.485403 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:21:23.485502 28547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.481854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:44221 (local address 127.30.35.193:38799)
0807 20:21:23.481915 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:23.481928 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:23.481974 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:23.482134 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:23.482135 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:23.482136 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:23.482211 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.482213 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.483105 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.483106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.484392 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.484395 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.485203 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.485204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.485294 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.485296 (+ 2us) client_negotiation.cc:769] Sending connection context
0807 20:21:23.485348 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 20:21:23.485402 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":38}
I20260807 20:21:23.485514 28974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.481855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:35249 (local address 127.30.35.193:42993)
0807 20:21:23.482074 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:23.482083 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:23.482133 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:23.482259 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:23.482260 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:23.482261 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:23.482315 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.482316 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.483146 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.483147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.484392 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.484395 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.485203 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.485204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.485289 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.485294 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:21:23.485348 (+ 54us) client_negotiation.cc:240] Negotiation successful
0807 20:21:23.485401 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":38,"thread_start_us":150,"threads_started":1}
I20260807 20:21:23.485940 28868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd788930d7e348d9af0d989194897507" candidate_uuid: "ef60bb8f87eb4642acdf612cc0233e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0758751565ea4f7eb028919b38931ef6" is_pre_election: true
I20260807 20:21:23.486109 28868 raft_consensus.cc:2454] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef60bb8f87eb4642acdf612cc0233e72 in term 0.
I20260807 20:21:23.486111 28674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd788930d7e348d9af0d989194897507" candidate_uuid: "ef60bb8f87eb4642acdf612cc0233e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f1ca26093be4d3aaff8c22a5472ea07" is_pre_election: true
I20260807 20:21:23.486266 28674 raft_consensus.cc:2454] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef60bb8f87eb4642acdf612cc0233e72 in term 0.
I20260807 20:21:23.486361 28381 leader_election.cc:302] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0758751565ea4f7eb028919b38931ef6, ef60bb8f87eb4642acdf612cc0233e72; no voters:
I20260807 20:21:23.486496 28970 raft_consensus.cc:2781] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:21:23.486567 28970 raft_consensus.cc:482] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:21:23.486583 28970 raft_consensus.cc:3037] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:23.487313 28970 raft_consensus.cc:504] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0758751565ea4f7eb028919b38931ef6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 44221 } } peers { permanent_uuid: "7f1ca26093be4d3aaff8c22a5472ea07" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 35249 } } peers { permanent_uuid: "ef60bb8f87eb4642acdf612cc0233e72" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34369 } }
I20260807 20:21:23.487453 28970 leader_election.cc:288] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [CANDIDATE]: Term 1 election: Requested vote from peers 0758751565ea4f7eb028919b38931ef6 (127.30.35.195:44221), 7f1ca26093be4d3aaff8c22a5472ea07 (127.30.35.194:35249)
I20260807 20:21:23.487622 28868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd788930d7e348d9af0d989194897507" candidate_uuid: "ef60bb8f87eb4642acdf612cc0233e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0758751565ea4f7eb028919b38931ef6"
I20260807 20:21:23.487645 28674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd788930d7e348d9af0d989194897507" candidate_uuid: "ef60bb8f87eb4642acdf612cc0233e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f1ca26093be4d3aaff8c22a5472ea07"
I20260807 20:21:23.487704 28868 raft_consensus.cc:3037] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:23.487709 28674 raft_consensus.cc:3037] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:23.488540 28674 raft_consensus.cc:2454] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef60bb8f87eb4642acdf612cc0233e72 in term 1.
I20260807 20:21:23.488540 28868 raft_consensus.cc:2454] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef60bb8f87eb4642acdf612cc0233e72 in term 1.
I20260807 20:21:23.488701 28381 leader_election.cc:302] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0758751565ea4f7eb028919b38931ef6, ef60bb8f87eb4642acdf612cc0233e72; no voters:
I20260807 20:21:23.488792 28970 raft_consensus.cc:2781] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:23.488917 28970 raft_consensus.cc:686] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [term 1 LEADER]: Becoming Leader. State: Replica: ef60bb8f87eb4642acdf612cc0233e72, State: Running, Role: LEADER
I20260807 20:21:23.489004 28970 consensus_queue.cc:237] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0758751565ea4f7eb028919b38931ef6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 44221 } } peers { permanent_uuid: "7f1ca26093be4d3aaff8c22a5472ea07" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 35249 } } peers { permanent_uuid: "ef60bb8f87eb4642acdf612cc0233e72" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34369 } }
I20260807 20:21:23.489910 28248 catalog_manager.cc:5495] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef60bb8f87eb4642acdf612cc0233e72 (127.30.35.193). New cstate: current_term: 1 leader_uuid: "ef60bb8f87eb4642acdf612cc0233e72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0758751565ea4f7eb028919b38931ef6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 44221 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f1ca26093be4d3aaff8c22a5472ea07" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 35249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef60bb8f87eb4642acdf612cc0233e72" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34369 } health_report { overall_health: HEALTHY } } }
I20260807 20:21:23.500805 28962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.498648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60868 (local address 127.30.35.193:34369)
0807 20:21:23.498695 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:23.498696 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:23.498704 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:21:23.498753 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:23.498754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:23.498770 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:23.498828 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:23.498920 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.499446 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.500205 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.500398 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.500442 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.500544 (+ 102us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:23.500638 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:23.500695 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:23.500712 (+ 17us) server_negotiation.cc:299] Negotiation successful
0807 20:21:23.500731 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260807 20:21:23.502512 28868 raft_consensus.cc:1261] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6 [term 1 FOLLOWER]: Refusing update from remote peer ef60bb8f87eb4642acdf612cc0233e72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:23.502539 28674 raft_consensus.cc:1261] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07 [term 1 FOLLOWER]: Refusing update from remote peer ef60bb8f87eb4642acdf612cc0233e72: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:23.502863 28975 consensus_queue.cc:1035] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0758751565ea4f7eb028919b38931ef6" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 44221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:23.502997 28970 consensus_queue.cc:1035] T fd788930d7e348d9af0d989194897507 P ef60bb8f87eb4642acdf612cc0233e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f1ca26093be4d3aaff8c22a5472ea07" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 35249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:23.506012 28981 mvcc.cc:205] Tried to move back new op lower bound from 7316005206023847936 to 7316005205971529728. Current Snapshot: MvccSnapshot[applied={T|T < 7316005206023847936}]
I20260807 20:21:23.506398 28980 mvcc.cc:205] Tried to move back new op lower bound from 7316005206023847936 to 7316005205971529728. Current Snapshot: MvccSnapshot[applied={T|T < 7316005206023847936}]
I20260807 20:21:23.506649 28983 mvcc.cc:205] Tried to move back new op lower bound from 7316005206023847936 to 7316005205971529728. Current Snapshot: MvccSnapshot[applied={T|T < 7316005206023847936}]
I20260807 20:21:23.508569 28248 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:21:23.508657 28248 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:21:23.509384 28248 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a67bdee4659546e08764dc37d1d0fce0: Sending DeleteTablet for 3 replicas of tablet fd788930d7e348d9af0d989194897507
I20260807 20:21:23.509720 28838 tablet_service.cc:1514] Processing DeleteTablet for tablet fd788930d7e348d9af0d989194897507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:23 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:40744
I20260807 20:21:23.509970 28648 tablet_service.cc:1514] Processing DeleteTablet for tablet fd788930d7e348d9af0d989194897507 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:23 UTC) from {username='kudu', principal='kudu/127.30.35.254@KRBTEST.COM'} at 127.0.0.1:50764
I20260807 20:21:23.510076 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 28352
I20260807 20:21:23.510653 28997 tablet_replica.cc:330] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6: stopping tablet replica
I20260807 20:21:23.510746 28997 raft_consensus.cc:2229] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:21:23.510834 28997 raft_consensus.cc:2258] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:21:23.510969 28998 tablet_replica.cc:330] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07: stopping tablet replica
I20260807 20:21:23.511037 28998 raft_consensus.cc:2229] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:21:23.511103 28998 raft_consensus.cc:2258] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:21:23.513149 28998 ts_tablet_manager.cc:1905] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:21:23.513150 28997 ts_tablet_manager.cc:1905] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:21:23.514766 28997 ts_tablet_manager.cc:1918] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:21:23.514839 28997 log.cc:1196] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/fd788930d7e348d9af0d989194897507
I20260807 20:21:23.515105 28997 ts_tablet_manager.cc:1939] T fd788930d7e348d9af0d989194897507 P 0758751565ea4f7eb028919b38931ef6: Deleting consensus metadata
I20260807 20:21:23.515545 28227 catalog_manager.cc:4841] TS 0758751565ea4f7eb028919b38931ef6 (127.30.35.195:44221): tablet fd788930d7e348d9af0d989194897507 (table test-table [id=3b18740801664b7f9d7a83d761562dc1]) successfully deleted
I20260807 20:21:23.516335 28998 ts_tablet_manager.cc:1918] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:21:23.516395 28998 log.cc:1196] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/fd788930d7e348d9af0d989194897507
I20260807 20:21:23.516614 28998 ts_tablet_manager.cc:1939] T fd788930d7e348d9af0d989194897507 P 7f1ca26093be4d3aaff8c22a5472ea07: Deleting consensus metadata
I20260807 20:21:23.516968 28225 catalog_manager.cc:4841] TS 7f1ca26093be4d3aaff8c22a5472ea07 (127.30.35.194:35249): tablet fd788930d7e348d9af0d989194897507 (table test-table [id=3b18740801664b7f9d7a83d761562dc1]) successfully deleted
W20260807 20:21:23.518707 28226 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:34369 (error 108)
I20260807 20:21:23.519017 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 28551
I20260807 20:21:23.519184 28958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.519070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:34369 (local address 127.0.0.1:60884)
0807 20:21:23.519119 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:23.519153 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:34369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 20:21:23.523695 28226 catalog_manager.cc:4584] TS ef60bb8f87eb4642acdf612cc0233e72 (127.30.35.193:34369): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fd788930d7e348d9af0d989194897507: Network error: Client connection negotiation failed: client connection to 127.30.35.193:34369: connect: Connection refused (error 111)
I20260807 20:21:23.531261 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 28748
I20260807 20:21:23.555852 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 28193
2026-08-07T20:21:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2137 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T20:21:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:23Z Disabled control of system clock
I20260807 20:21:23.592374 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:34085
--webserver_interface=127.30.35.254
--webserver_port=0
--builtin_ntp_servers=127.30.35.212:46529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:34085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 20:21:23.676141 29007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:23.676383 29007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:23.676401 29007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:23.677513 29007 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:23.677546 29007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:23.677557 29007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:23.677568 29007 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:23.677584 29007 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:23.678972 29007 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:46529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:34085
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:34085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:23.679178 29007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:23.679415 29007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:23.683936 29021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:23.684024 29007 server_base.cc:1034] running on GCE node
W20260807 20:21:23.683912 29017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:23.684149 29016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:23.684442 29007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:23.684725 29007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:23.685876 29007 hybrid_clock.cc:648] HybridClock initialized: now 1786134083685859 us; error 36 us; skew 500 ppm
I20260807 20:21:23.687080 29007 webserver.cc:460] Webserver started at http://127.30.35.254:45787/ using document root <none> and password file <none>
I20260807 20:21:23.687302 29007 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:23.687348 29007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:23.687489 29007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:23.688510 29007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "bed0de98a45a4fbd852af54e1be9797f"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "8bb825251b467f71c0104b15c7018ad8"
server_key_iv: "dd6e17faed5bfd8ab2eea0f3eb424f7a"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.688848 29007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "bed0de98a45a4fbd852af54e1be9797f"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "8bb825251b467f71c0104b15c7018ad8"
server_key_iv: "dd6e17faed5bfd8ab2eea0f3eb424f7a"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.690145 29007 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:21:23.690914 29030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.691072 29007 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:21:23.691160 29007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "bed0de98a45a4fbd852af54e1be9797f"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "8bb825251b467f71c0104b15c7018ad8"
server_key_iv: "dd6e17faed5bfd8ab2eea0f3eb424f7a"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.691220 29007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:23.702606 29007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:23.702899 29007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:23.703033 29007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:23.706911 29007 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:34085
I20260807 20:21:23.706947 29114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:34085 every 8 connection(s)
I20260807 20:21:23.707271 29007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:23.708210 29116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:23.710590 29116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f: Bootstrap starting.
I20260807 20:21:23.711151 29116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:23.711431 29116 log.cc:824] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:23.712108 29116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f: No bootstrap required, opened a new log
I20260807 20:21:23.713773 29116 raft_consensus.cc:348] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed0de98a45a4fbd852af54e1be9797f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34085 } }
I20260807 20:21:23.713924 29116 raft_consensus.cc:374] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:23.713956 29116 raft_consensus.cc:729] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed0de98a45a4fbd852af54e1be9797f, State: Initialized, Role: FOLLOWER
I20260807 20:21:23.714099 29116 consensus_queue.cc:260] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed0de98a45a4fbd852af54e1be9797f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34085 } }
I20260807 20:21:23.714159 29116 raft_consensus.cc:388] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:23.714181 29116 raft_consensus.cc:482] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:23.714227 29116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:23.714720 29116 raft_consensus.cc:504] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed0de98a45a4fbd852af54e1be9797f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34085 } }
I20260807 20:21:23.714824 29116 leader_election.cc:302] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bed0de98a45a4fbd852af54e1be9797f; no voters:
I20260807 20:21:23.714987 29116 leader_election.cc:288] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:23.715034 29122 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:23.715196 29122 raft_consensus.cc:686] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [term 1 LEADER]: Becoming Leader. State: Replica: bed0de98a45a4fbd852af54e1be9797f, State: Running, Role: LEADER
I20260807 20:21:23.715217 29116 sys_catalog.cc:564] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:23.715324 29122 consensus_queue.cc:237] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed0de98a45a4fbd852af54e1be9797f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34085 } }
I20260807 20:21:23.715788 29123 sys_catalog.cc:455] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bed0de98a45a4fbd852af54e1be9797f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed0de98a45a4fbd852af54e1be9797f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34085 } } }
I20260807 20:21:23.715888 29123 sys_catalog.cc:458] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:23.716049 29124 sys_catalog.cc:455] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [sys.catalog]: SysCatalogTable state changed. Reason: New leader bed0de98a45a4fbd852af54e1be9797f. Latest consensus state: current_term: 1 leader_uuid: "bed0de98a45a4fbd852af54e1be9797f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bed0de98a45a4fbd852af54e1be9797f" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 34085 } } }
I20260807 20:21:23.716094 29131 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:23.716109 29124 sys_catalog.cc:458] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:23.716653 29131 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:23.716825 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 29007
I20260807 20:21:23.716917 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:23.717110 30863 external_mini_cluster.cc:1428] Setting key a1920f0f316c555bea3a613fed2ba0f2
I20260807 20:21:23.718654 29131 catalog_manager.cc:1347] Generated new cluster ID: 873108bb9e6d423a98046b71d1645309
I20260807 20:21:23.718711 29131 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:23.722128 29131 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:23.722587 29131 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:23.725725 29131 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f: Generated new TSK 0
I20260807 20:21:23.725886 29131 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:23.726377 29144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.717598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41766 (local address 127.30.35.254:34085)
0807 20:21:23.717824 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:23.717833 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:23.717865 (+ 32us) server_negotiation.cc:407] Connection header received
0807 20:21:23.717982 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:23.717987 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:23.718048 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:23.718194 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:23.718447 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.719807 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.720933 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.721544 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.721691 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.725540 (+ 3849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:23.725544 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:23.725545 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:23.725791 (+ 246us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:23.725838 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:23.725854 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:23.725917 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:23.726073 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 20:21:23.726155 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":97,"threads_started":1}
I20260807 20:21:23.727847 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.193:0
--local_ip_for_outbound_sockets=127.30.35.193
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34085
--builtin_ntp_servers=127.30.35.212:46529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 20:21:23.810874 29146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:23.811097 29146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:23.811120 29146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:23.812268 29146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:23.812310 29146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:23.812335 29146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.193
I20260807 20:21:23.813726 29146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:46529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.30.35.193
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34085
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.193
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:23.813957 29146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:23.814258 29146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:23.820153 29155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:23.820149 29153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:23.820153 29157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:23.820374 29146 server_base.cc:1034] running on GCE node
I20260807 20:21:23.820585 29146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:23.820801 29146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:23.821943 29146 hybrid_clock.cc:648] HybridClock initialized: now 1786134083821933 us; error 28 us; skew 500 ppm
I20260807 20:21:23.823199 29146 webserver.cc:460] Webserver started at http://127.30.35.193:36157/ using document root <none> and password file <none>
I20260807 20:21:23.823413 29146 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:23.823475 29146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:23.823603 29146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:23.824658 29146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/data/instance:
uuid: "5ef2f5a69b6a4657beea9f940ae07a5c"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "ed0ac4d1b32de1c09437a38f4f51770e"
server_key_iv: "0159f8d6a330374036e924398f505d86"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.825011 29146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance:
uuid: "5ef2f5a69b6a4657beea9f940ae07a5c"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "ed0ac4d1b32de1c09437a38f4f51770e"
server_key_iv: "0159f8d6a330374036e924398f505d86"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.826294 29146 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:21:23.827000 29164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.827176 29146 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:23.827277 29146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/wal
uuid: "5ef2f5a69b6a4657beea9f940ae07a5c"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "ed0ac4d1b32de1c09437a38f4f51770e"
server_key_iv: "0159f8d6a330374036e924398f505d86"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.827353 29146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:23.839879 29146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:23.840185 29146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:23.840317 29146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:23.840531 29146 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:23.840878 29146 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:23.840922 29146 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.840957 29146 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:23.840981 29146 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.847755 29146 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.193:34889
I20260807 20:21:23.847810 29316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.193:34889 every 8 connection(s)
I20260807 20:21:23.848130 29146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/data/info.pb
I20260807 20:21:23.853103 29144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.848798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:40777 (local address 127.30.35.254:34085)
0807 20:21:23.848851 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:23.848853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:23.849105 (+ 252us) server_negotiation.cc:407] Connection header received
0807 20:21:23.849634 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:23.849635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:23.849682 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:23.849737 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:23.850409 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.850911 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.851854 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.852043 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.852098 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.852846 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:23.852847 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:23.852847 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:23.852852 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:23.852868 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:23.852872 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:23.852918 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:23.852991 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 20:21:23.853023 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 20:21:23.853330 29319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.848798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34085 (local address 127.30.35.193:40777)
0807 20:21:23.848976 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:23.849020 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:23.849536 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:23.849812 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:23.849816 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:23.849826 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:23.850325 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.850330 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.850998 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.850999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.851774 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.851777 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.852114 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.852115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.852244 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.852721 (+ 477us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:21:23.852722 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:23.852749 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:21:23.852772 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:23.852924 (+ 152us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:23.852930 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:23.852933 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:23.852990 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 20:21:23.853093 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
I20260807 20:21:23.853415 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 29146
I20260807 20:21:23.853530 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-0/wal/instance
I20260807 20:21:23.853808 30863 external_mini_cluster.cc:1428] Setting key c720eefb9907cbeabe1d89a5657b5d24
I20260807 20:21:23.853937 29317 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34085
I20260807 20:21:23.854053 29317 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:23.854228 29317 heartbeater.cc:511] Master 127.30.35.254:34085 requested a full tablet report, sending...
I20260807 20:21:23.854693 29050 ts_manager.cc:194] Registered new tserver with Master: 5ef2f5a69b6a4657beea9f940ae07a5c (127.30.35.193:34889)
I20260807 20:21:23.854704 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.194:0
--local_ip_for_outbound_sockets=127.30.35.194
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34085
--builtin_ntp_servers=127.30.35.212:46529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 20:21:23.855319 29050 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.35.193:40777
W20260807 20:21:23.937580 29320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:23.937804 29320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:23.937824 29320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:23.938926 29320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:23.938959 29320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:23.938982 29320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.194
I20260807 20:21:23.940308 29320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:46529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.30.35.194
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34085
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.194
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:23.940512 29320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:23.940755 29320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:23.945425 29327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:23.945420 29330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:23.945501 29328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:23.945808 29320 server_base.cc:1034] running on GCE node
I20260807 20:21:23.945983 29320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:23.946173 29320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:23.947304 29320 hybrid_clock.cc:648] HybridClock initialized: now 1786134083947289 us; error 28 us; skew 500 ppm
I20260807 20:21:23.948521 29320 webserver.cc:460] Webserver started at http://127.30.35.194:38959/ using document root <none> and password file <none>
I20260807 20:21:23.948765 29320 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:23.948819 29320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:23.948951 29320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:23.950078 29320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/data/instance:
uuid: "9ead0f0623cc4f78aec63474a9ea98dc"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "30626d58ff17fca4e12c299361504fc7"
server_key_iv: "7de0692fe76067a49c87b9d3a7a91af3"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.950412 29320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance:
uuid: "9ead0f0623cc4f78aec63474a9ea98dc"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "30626d58ff17fca4e12c299361504fc7"
server_key_iv: "7de0692fe76067a49c87b9d3a7a91af3"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.951673 29320 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 20:21:23.952399 29339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.952560 29320 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:21:23.952648 29320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/wal
uuid: "9ead0f0623cc4f78aec63474a9ea98dc"
format_stamp: "Formatted at 2026-08-07 20:21:23 on dist-test-slave-t7g5"
server_key: "30626d58ff17fca4e12c299361504fc7"
server_key_iv: "7de0692fe76067a49c87b9d3a7a91af3"
server_key_version: "encryptionkey@0"
I20260807 20:21:23.952710 29320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:23.972637 29320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:23.972934 29320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:23.973066 29320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:23.973271 29320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:23.973603 29320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:23.973637 29320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.973697 29320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:23.973723 29320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:23.979171 29320 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.194:45207
I20260807 20:21:23.979225 29507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.194:45207 every 8 connection(s)
I20260807 20:21:23.979557 29320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/data/info.pb
I20260807 20:21:23.980440 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 29320
I20260807 20:21:23.980563 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/wal/instance
I20260807 20:21:23.980804 30863 external_mini_cluster.cc:1428] Setting key 1a484772d53dd68ecb0603b94b7a65ed
I20260807 20:21:23.981839 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.30.35.195:0
--local_ip_for_outbound_sockets=127.30.35.195
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34085
--builtin_ntp_servers=127.30.35.212:46529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 20:21:23.985239 29144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.980311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.194:55135 (local address 127.30.35.254:34085)
0807 20:21:23.980364 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:23.980366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:23.980708 (+ 342us) server_negotiation.cc:407] Connection header received
0807 20:21:23.981305 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:23.981306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:23.981316 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:23.981365 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:23.982197 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.982868 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.983880 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.984080 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.984140 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.984995 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:23.984996 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:23.984996 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:23.985002 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:23.985020 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:23.985025 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:23.985079 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:23.985134 (+ 55us) server_negotiation.cc:299] Negotiation successful
0807 20:21:23.985165 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260807 20:21:23.985435 29510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:23.980321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34085 (local address 127.30.35.194:55135)
0807 20:21:23.980569 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:23.980616 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:23.981200 (+ 584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:23.981447 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:23.981461 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:23.981472 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:23.982110 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.982117 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.982950 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.982951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.983801 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:23.983803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:23.984158 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:23.984159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:23.984301 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:23.984853 (+ 552us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:21:23.984854 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:23.984884 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:21:23.984909 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:23.985083 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:23.985086 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:23.985089 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:23.985134 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:21:23.985216 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":105,"threads_started":1}
I20260807 20:21:23.985904 29508 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34085
I20260807 20:21:23.985987 29508 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:23.986151 29508 heartbeater.cc:511] Master 127.30.35.254:34085 requested a full tablet report, sending...
I20260807 20:21:23.986559 29050 ts_manager.cc:194] Registered new tserver with Master: 9ead0f0623cc4f78aec63474a9ea98dc (127.30.35.194:45207)
I20260807 20:21:23.987042 29050 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.35.194:55135
W20260807 20:21:24.065119 29515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:24.065330 29515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:24.065351 29515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:24.066483 29515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:24.066525 29515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:24.066548 29515 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.35.195
I20260807 20:21:24.067830 29515 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:46529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.30.35.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.30.35.195
--webserver_port=0
--tserver_master_addrs=127.30.35.254:34085
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.30.35.195
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:24.068024 29515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:24.068267 29515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:24.073096 29523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:24.073155 29524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:24.073103 29526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:24.073227 29515 server_base.cc:1034] running on GCE node
I20260807 20:21:24.073486 29515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:24.073751 29515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:24.074891 29515 hybrid_clock.cc:648] HybridClock initialized: now 1786134084074888 us; error 44 us; skew 500 ppm
I20260807 20:21:24.076128 29515 webserver.cc:460] Webserver started at http://127.30.35.195:39491/ using document root <none> and password file <none>
I20260807 20:21:24.076344 29515 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:24.076393 29515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:24.076521 29515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:24.077549 29515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/data/instance:
uuid: "54f327c027814460b1a7174446e12654"
format_stamp: "Formatted at 2026-08-07 20:21:24 on dist-test-slave-t7g5"
server_key: "1d670973ea63adbf67dbd1d9dd75fa27"
server_key_iv: "31fa00fed78c31f6952df9485473ed79"
server_key_version: "encryptionkey@0"
I20260807 20:21:24.077943 29515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance:
uuid: "54f327c027814460b1a7174446e12654"
format_stamp: "Formatted at 2026-08-07 20:21:24 on dist-test-slave-t7g5"
server_key: "1d670973ea63adbf67dbd1d9dd75fa27"
server_key_iv: "31fa00fed78c31f6952df9485473ed79"
server_key_version: "encryptionkey@0"
I20260807 20:21:24.079169 29515 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:21:24.079820 29535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:24.080027 29515 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:24.080116 29515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/wal
uuid: "54f327c027814460b1a7174446e12654"
format_stamp: "Formatted at 2026-08-07 20:21:24 on dist-test-slave-t7g5"
server_key: "1d670973ea63adbf67dbd1d9dd75fa27"
server_key_iv: "31fa00fed78c31f6952df9485473ed79"
server_key_version: "encryptionkey@0"
I20260807 20:21:24.080188 29515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:24.100260 29515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:24.100543 29515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:24.100648 29515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:24.100821 29515 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 20:21:24.101087 29515 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 20:21:24.101117 29515 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:24.101137 29515 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 20:21:24.101153 29515 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:24.106510 29515 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.195:42417
I20260807 20:21:24.106550 29710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.195:42417 every 8 connection(s)
I20260807 20:21:24.106848 29515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/data/info.pb
I20260807 20:21:24.107962 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 29515
I20260807 20:21:24.108069 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/wal/instance
I20260807 20:21:24.108275 30863 external_mini_cluster.cc:1428] Setting key 374d2359c04987954df1fbf3f75fd00d
I20260807 20:21:24.112063 29144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.107544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.195:35609 (local address 127.30.35.254:34085)
0807 20:21:24.107602 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:24.107604 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:24.107840 (+ 236us) server_negotiation.cc:407] Connection header received
0807 20:21:24.108503 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:24.108505 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:24.108522 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:24.108570 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:24.109306 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.109810 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.110770 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.110970 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.111025 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:24.111805 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:24.111806 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:24.111806 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:24.111811 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:24.111826 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:24.111830 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:24.111881 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:24.111954 (+ 73us) server_negotiation.cc:299] Negotiation successful
0807 20:21:24.111985 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 20:21:24.112257 29713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.107542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:34085 (local address 127.30.35.195:35609)
0807 20:21:24.107712 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:24.107745 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:24.108390 (+ 645us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:24.108656 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:24.108659 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:24.108667 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:24.109227 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:24.109232 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.109903 (+ 671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.109904 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:24.110691 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:24.110693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.111044 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.111045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:24.111180 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:24.111672 (+ 492us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 20:21:24.111672 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:24.111702 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 20:21:24.111725 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:24.111888 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:24.111894 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:24.111897 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:24.111958 (+ 61us) client_negotiation.cc:240] Negotiation successful
0807 20:21:24.112061 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
I20260807 20:21:24.112650 29711 heartbeater.cc:347] Connected to a master server at 127.30.35.254:34085
I20260807 20:21:24.112733 29711 heartbeater.cc:464] Registering TS with master...
I20260807 20:21:24.112885 29711 heartbeater.cc:511] Master 127.30.35.254:34085 requested a full tablet report, sending...
I20260807 20:21:24.113195 29050 ts_manager.cc:194] Registered new tserver with Master: 54f327c027814460b1a7174446e12654 (127.30.35.195:42417)
I20260807 20:21:24.113566 29050 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.30.35.195:35609
I20260807 20:21:24.119946 30863 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 20:21:24.124096 29144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.121272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41768 (local address 127.30.35.254:34085)
0807 20:21:24.121333 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:24.121335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:24.121442 (+ 107us) server_negotiation.cc:407] Connection header received
0807 20:21:24.121503 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:24.121504 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:24.121515 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:24.121562 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:24.121739 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.122228 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.122987 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.123156 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.123197 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:24.123851 (+ 654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:24.123852 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:24.123853 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:24.123857 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:24.123875 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:24.123879 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:24.123936 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:24.123991 (+ 55us) server_negotiation.cc:299] Negotiation successful
0807 20:21:24.124015 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 20:21:24.125473 29050 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41768:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 20:21:24.127080 29050 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 20:21:24.133298 29726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.129135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:34889 (local address 127.0.0.1:47060)
0807 20:21:24.129316 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:24.129358 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:24.129427 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:24.129690 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:24.129693 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:24.129696 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:24.129760 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:24.129762 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.131039 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.131040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:24.132292 (+ 1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:24.132296 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.132990 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.132991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:24.133073 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:24.133088 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 20:21:24.133162 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 20:21:24.133217 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":25,"thread_start_us":91,"threads_started":1}
I20260807 20:21:24.133308 29732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.129245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47060 (local address 127.30.35.193:34889)
0807 20:21:24.129428 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:24.129433 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:24.129444 (+ 11us) server_negotiation.cc:407] Connection header received
0807 20:21:24.129508 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:24.129510 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:24.129525 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:24.129591 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:24.129844 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.130959 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.132393 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.132909 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.132976 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:24.133075 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:24.133178 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 20:21:24.133215 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":87,"threads_started":1}
I20260807 20:21:24.133564 29730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.129135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:42417 (local address 127.0.0.1:59502)
0807 20:21:24.129683 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:24.129694 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:24.129759 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:24.129967 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:24.129968 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:24.129971 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:24.130014 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:24.130015 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.130964 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.130965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:24.132381 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:24.132384 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.133332 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.133333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:24.133385 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:24.133388 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:24.133433 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:21:24.133480 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"mutex_wait_us":43,"thread_start_us":74,"threads_started":1}
I20260807 20:21:24.133831 29735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.129410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33664 (local address 127.30.35.194:45207)
0807 20:21:24.129598 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:24.129603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:24.129816 (+ 213us) server_negotiation.cc:407] Connection header received
0807 20:21:24.129864 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:24.129867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:24.129884 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:24.130142 (+ 258us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:24.130322 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.131301 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.132330 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.133032 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.133100 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:24.133190 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:24.133703 (+ 513us) server_negotiation.cc:299] Negotiation successful
0807 20:21:24.133748 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":80,"threads_started":1}
I20260807 20:21:24.133895 29736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.129474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59502 (local address 127.30.35.195:42417)
0807 20:21:24.129636 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:24.129640 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:24.129766 (+ 126us) server_negotiation.cc:407] Connection header received
0807 20:21:24.129877 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:24.129880 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:24.129899 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:24.129971 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:24.130133 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.130889 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.132456 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.133164 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.133222 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:24.133301 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:24.133755 (+ 454us) server_negotiation.cc:299] Negotiation successful
0807 20:21:24.133811 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260807 20:21:24.133574 29728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.129144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:45207 (local address 127.0.0.1:33664)
0807 20:21:24.129690 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:24.129698 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:24.129759 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:24.130208 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:24.130209 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:24.130216 (+ 7us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:24.130253 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:24.130255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.131379 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.131380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:24.132252 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:24.132255 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.133227 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.133228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:24.133302 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:24.133307 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 20:21:24.133354 (+ 47us) client_negotiation.cc:240] Negotiation successful
0807 20:21:24.133514 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":110,"threads_started":1}
I20260807 20:21:24.134078 29224 tablet_service.cc:1467] Processing CreateTablet for tablet 1444e1c89e5444a48cc0d5243c8e2d78 (DEFAULT_TABLE table=test-table [id=421b8f0a324d423293c559950c813472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:24.134506 29224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1444e1c89e5444a48cc0d5243c8e2d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:24.134517 29605 tablet_service.cc:1467] Processing CreateTablet for tablet 1444e1c89e5444a48cc0d5243c8e2d78 (DEFAULT_TABLE table=test-table [id=421b8f0a324d423293c559950c813472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:24.134836 29605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1444e1c89e5444a48cc0d5243c8e2d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:24.137229 29738 tablet_bootstrap.cc:492] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654: Bootstrap starting.
I20260807 20:21:24.138008 29738 tablet_bootstrap.cc:654] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:24.137951 29407 tablet_service.cc:1467] Processing CreateTablet for tablet 1444e1c89e5444a48cc0d5243c8e2d78 (DEFAULT_TABLE table=test-table [id=421b8f0a324d423293c559950c813472]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 20:21:24.138316 29407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1444e1c89e5444a48cc0d5243c8e2d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:24.138339 29738 log.cc:824] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:24.139123 29738 tablet_bootstrap.cc:492] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654: No bootstrap required, opened a new log
I20260807 20:21:24.139201 29738 ts_tablet_manager.cc:1397] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260807 20:21:24.137475 29737 tablet_bootstrap.cc:492] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c: Bootstrap starting.
I20260807 20:21:24.141422 29737 tablet_bootstrap.cc:654] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:24.141791 29737 log.cc:824] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:24.141737 29738 raft_consensus.cc:348] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f327c027814460b1a7174446e12654" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42417 } } peers { permanent_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34889 } } peers { permanent_uuid: "9ead0f0623cc4f78aec63474a9ea98dc" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 45207 } }
I20260807 20:21:24.141916 29738 raft_consensus.cc:374] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:24.141960 29738 raft_consensus.cc:729] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54f327c027814460b1a7174446e12654, State: Initialized, Role: FOLLOWER
I20260807 20:21:24.142103 29738 consensus_queue.cc:260] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f327c027814460b1a7174446e12654" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42417 } } peers { permanent_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34889 } } peers { permanent_uuid: "9ead0f0623cc4f78aec63474a9ea98dc" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 45207 } }
I20260807 20:21:24.142373 29738 ts_tablet_manager.cc:1428] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260807 20:21:24.142546 29711 heartbeater.cc:503] Master 127.30.35.254:34085 was elected leader, sending a full tablet report...
I20260807 20:21:24.142637 29737 tablet_bootstrap.cc:492] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c: No bootstrap required, opened a new log
I20260807 20:21:24.142638 29741 tablet_bootstrap.cc:492] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc: Bootstrap starting.
I20260807 20:21:24.142694 29737 ts_tablet_manager.cc:1397] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260807 20:21:24.143221 29741 tablet_bootstrap.cc:654] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:24.143538 29741 log.cc:824] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:24.144227 29741 tablet_bootstrap.cc:492] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc: No bootstrap required, opened a new log
I20260807 20:21:24.144284 29741 ts_tablet_manager.cc:1397] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260807 20:21:24.144814 29737 raft_consensus.cc:348] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f327c027814460b1a7174446e12654" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42417 } } peers { permanent_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34889 } } peers { permanent_uuid: "9ead0f0623cc4f78aec63474a9ea98dc" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 45207 } }
I20260807 20:21:24.144941 29737 raft_consensus.cc:374] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:24.144972 29737 raft_consensus.cc:729] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ef2f5a69b6a4657beea9f940ae07a5c, State: Initialized, Role: FOLLOWER
I20260807 20:21:24.145083 29737 consensus_queue.cc:260] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f327c027814460b1a7174446e12654" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42417 } } peers { permanent_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34889 } } peers { permanent_uuid: "9ead0f0623cc4f78aec63474a9ea98dc" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 45207 } }
I20260807 20:21:24.145340 29737 ts_tablet_manager.cc:1428] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:21:24.145387 29317 heartbeater.cc:503] Master 127.30.35.254:34085 was elected leader, sending a full tablet report...
I20260807 20:21:24.146503 29741 raft_consensus.cc:348] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f327c027814460b1a7174446e12654" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42417 } } peers { permanent_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34889 } } peers { permanent_uuid: "9ead0f0623cc4f78aec63474a9ea98dc" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 45207 } }
I20260807 20:21:24.146636 29741 raft_consensus.cc:374] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:24.146656 29741 raft_consensus.cc:729] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ead0f0623cc4f78aec63474a9ea98dc, State: Initialized, Role: FOLLOWER
I20260807 20:21:24.146732 29741 consensus_queue.cc:260] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f327c027814460b1a7174446e12654" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42417 } } peers { permanent_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34889 } } peers { permanent_uuid: "9ead0f0623cc4f78aec63474a9ea98dc" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 45207 } }
I20260807 20:21:24.146911 29741 ts_tablet_manager.cc:1428] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 20:21:24.146993 29508 heartbeater.cc:503] Master 127.30.35.254:34085 was elected leader, sending a full tablet report...
W20260807 20:21:24.230084 29509 tablet.cc:2369] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:21:24.348855 29318 tablet.cc:2369] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 20:21:24.357362 29712 tablet.cc:2369] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:21:24.367218 29751 raft_consensus.cc:482] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 20:21:24.367367 29751 raft_consensus.cc:504] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f327c027814460b1a7174446e12654" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42417 } } peers { permanent_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34889 } } peers { permanent_uuid: "9ead0f0623cc4f78aec63474a9ea98dc" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 45207 } }
I20260807 20:21:24.367779 29751 leader_election.cc:288] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54f327c027814460b1a7174446e12654 (127.30.35.195:42417), 9ead0f0623cc4f78aec63474a9ea98dc (127.30.35.194:45207)
I20260807 20:21:24.370715 29735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.368094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:58211 (local address 127.30.35.194:45207)
0807 20:21:24.368142 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:24.368144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:24.368231 (+ 87us) server_negotiation.cc:407] Connection header received
0807 20:21:24.368276 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:24.368277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:24.368286 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:24.368333 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:24.368504 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.368974 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.370037 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.370401 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.370465 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:24.370473 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:24.370606 (+ 133us) server_negotiation.cc:299] Negotiation successful
0807 20:21:24.370645 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 20:21:24.370733 29736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.368050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.30.35.193:42487 (local address 127.30.35.195:42417)
0807 20:21:24.368098 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:24.368100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:24.368228 (+ 128us) server_negotiation.cc:407] Connection header received
0807 20:21:24.368280 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:24.368281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:24.368291 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:24.368342 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 20:21:24.368520 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.368973 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.370040 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.370411 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.370475 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:24.370484 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:24.370625 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 20:21:24.370666 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:21:24.370748 29755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.367979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.195:42417 (local address 127.30.35.193:42487)
0807 20:21:24.368140 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:24.368151 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:24.368218 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:24.368349 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:24.368350 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:24.368352 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:24.368455 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:24.368457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.369050 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.369051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:24.369952 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:24.369955 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.370489 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.370490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:24.370558 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:24.370561 (+ 3us) client_negotiation.cc:769] Sending connection context
0807 20:21:24.370607 (+ 46us) client_negotiation.cc:240] Negotiation successful
0807 20:21:24.370649 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":18,"thread_start_us":73,"threads_started":1}
I20260807 20:21:24.370747 29756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.368026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.194:45207 (local address 127.30.35.193:58211)
0807 20:21:24.368147 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:24.368157 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:24.368222 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:24.368349 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:24.368350 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:24.368355 (+ 5us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 20:21:24.368442 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:24.368444 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.369044 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.369045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:24.369948 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:24.369951 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.370472 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.370473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:24.370542 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:24.370546 (+ 4us) client_negotiation.cc:769] Sending connection context
0807 20:21:24.370591 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:21:24.370636 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":41,"thread_start_us":82,"threads_started":1}
I20260807 20:21:24.371147 29639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1444e1c89e5444a48cc0d5243c8e2d78" candidate_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f327c027814460b1a7174446e12654" is_pre_election: true
I20260807 20:21:24.371246 29437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1444e1c89e5444a48cc0d5243c8e2d78" candidate_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ead0f0623cc4f78aec63474a9ea98dc" is_pre_election: true
I20260807 20:21:24.371321 29639 raft_consensus.cc:2454] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ef2f5a69b6a4657beea9f940ae07a5c in term 0.
I20260807 20:21:24.371413 29437 raft_consensus.cc:2454] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ef2f5a69b6a4657beea9f940ae07a5c in term 0.
I20260807 20:21:24.371568 29171 leader_election.cc:302] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54f327c027814460b1a7174446e12654, 5ef2f5a69b6a4657beea9f940ae07a5c; no voters:
I20260807 20:21:24.371721 29751 raft_consensus.cc:2781] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 20:21:24.371774 29751 raft_consensus.cc:482] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 20:21:24.371801 29751 raft_consensus.cc:3037] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:24.372519 29751 raft_consensus.cc:504] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f327c027814460b1a7174446e12654" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42417 } } peers { permanent_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34889 } } peers { permanent_uuid: "9ead0f0623cc4f78aec63474a9ea98dc" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 45207 } }
I20260807 20:21:24.372653 29751 leader_election.cc:288] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [CANDIDATE]: Term 1 election: Requested vote from peers 54f327c027814460b1a7174446e12654 (127.30.35.195:42417), 9ead0f0623cc4f78aec63474a9ea98dc (127.30.35.194:45207)
I20260807 20:21:24.372802 29639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1444e1c89e5444a48cc0d5243c8e2d78" candidate_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54f327c027814460b1a7174446e12654"
I20260807 20:21:24.372818 29437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1444e1c89e5444a48cc0d5243c8e2d78" candidate_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ead0f0623cc4f78aec63474a9ea98dc"
I20260807 20:21:24.372882 29437 raft_consensus.cc:3037] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:24.372885 29639 raft_consensus.cc:3037] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:24.373591 29437 raft_consensus.cc:2454] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ef2f5a69b6a4657beea9f940ae07a5c in term 1.
I20260807 20:21:24.373608 29639 raft_consensus.cc:2454] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ef2f5a69b6a4657beea9f940ae07a5c in term 1.
I20260807 20:21:24.373768 29167 leader_election.cc:302] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ef2f5a69b6a4657beea9f940ae07a5c, 9ead0f0623cc4f78aec63474a9ea98dc; no voters:
I20260807 20:21:24.373890 29751 raft_consensus.cc:2781] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:24.374053 29751 raft_consensus.cc:686] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [term 1 LEADER]: Becoming Leader. State: Replica: 5ef2f5a69b6a4657beea9f940ae07a5c, State: Running, Role: LEADER
I20260807 20:21:24.374168 29751 consensus_queue.cc:237] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f327c027814460b1a7174446e12654" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42417 } } peers { permanent_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34889 } } peers { permanent_uuid: "9ead0f0623cc4f78aec63474a9ea98dc" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 45207 } }
I20260807 20:21:24.374948 29050 catalog_manager.cc:5495] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ef2f5a69b6a4657beea9f940ae07a5c (127.30.35.193). New cstate: current_term: 1 leader_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54f327c027814460b1a7174446e12654" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42417 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ef2f5a69b6a4657beea9f940ae07a5c" member_type: VOTER last_known_addr { host: "127.30.35.193" port: 34889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9ead0f0623cc4f78aec63474a9ea98dc" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 45207 } health_report { overall_health: UNKNOWN } } }
I20260807 20:21:24.414844 29732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.412758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47076 (local address 127.30.35.193:34889)
0807 20:21:24.412812 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:24.412814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:24.412823 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:21:24.412865 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:24.412865 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:24.412887 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:24.412949 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:24.413068 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.413528 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.414228 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:24.414416 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:24.414462 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:24.414565 (+ 103us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:24.414670 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:24.414725 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:24.414737 (+ 12us) server_negotiation.cc:299] Negotiation successful
0807 20:21:24.414754 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260807 20:21:24.416797 29437 raft_consensus.cc:1261] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc [term 1 FOLLOWER]: Refusing update from remote peer 5ef2f5a69b6a4657beea9f940ae07a5c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:24.416797 29639 raft_consensus.cc:1261] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654 [term 1 FOLLOWER]: Refusing update from remote peer 5ef2f5a69b6a4657beea9f940ae07a5c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:24.417177 29751 consensus_queue.cc:1035] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "54f327c027814460b1a7174446e12654" member_type: VOTER last_known_addr { host: "127.30.35.195" port: 42417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:24.417327 29757 consensus_queue.cc:1035] T 1444e1c89e5444a48cc0d5243c8e2d78 P 5ef2f5a69b6a4657beea9f940ae07a5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ead0f0623cc4f78aec63474a9ea98dc" member_type: VOTER last_known_addr { host: "127.30.35.194" port: 45207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:24.419896 29764 mvcc.cc:205] Tried to move back new op lower bound from 7316005209768431616 to 7316005209597247488. Current Snapshot: MvccSnapshot[applied={T|T < 7316005209768431616}]
I20260807 20:21:24.420346 29765 mvcc.cc:205] Tried to move back new op lower bound from 7316005209768431616 to 7316005209597247488. Current Snapshot: MvccSnapshot[applied={T|T < 7316005209768431616}]
I20260807 20:21:24.422349 29050 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:21:24.422447 29050 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41768:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 20:21:24.423187 29050 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bed0de98a45a4fbd852af54e1be9797f: Sending DeleteTablet for 3 replicas of tablet 1444e1c89e5444a48cc0d5243c8e2d78
I20260807 20:21:24.423533 29407 tablet_service.cc:1514] Processing DeleteTablet for tablet 1444e1c89e5444a48cc0d5243c8e2d78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:24 UTC) from {username='slave'} at 127.0.0.1:33664
I20260807 20:21:24.423542 29605 tablet_service.cc:1514] Processing DeleteTablet for tablet 1444e1c89e5444a48cc0d5243c8e2d78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:24 UTC) from {username='slave'} at 127.0.0.1:59502
I20260807 20:21:24.423779 29776 tablet_replica.cc:330] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654: stopping tablet replica
I20260807 20:21:24.423758 29224 tablet_service.cc:1514] Processing DeleteTablet for tablet 1444e1c89e5444a48cc0d5243c8e2d78 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 20:21:24 UTC) from {username='slave'} at 127.0.0.1:47060
I20260807 20:21:24.423779 29774 tablet_replica.cc:330] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc: stopping tablet replica
I20260807 20:21:24.423866 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 29146
I20260807 20:21:24.423878 29774 raft_consensus.cc:2229] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:21:24.423884 29776 raft_consensus.cc:2229] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 20:21:24.423970 29774 raft_consensus.cc:2258] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:21:24.424005 29776 raft_consensus.cc:2258] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 20:21:24.424460 29774 ts_tablet_manager.cc:1905] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:21:24.431542 29776 ts_tablet_manager.cc:1905] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 20:21:24.431901 29774 ts_tablet_manager.cc:1918] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:21:24.431984 29774 log.cc:1196] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-1/wal/wals/1444e1c89e5444a48cc0d5243c8e2d78
I20260807 20:21:24.432236 29774 ts_tablet_manager.cc:1939] T 1444e1c89e5444a48cc0d5243c8e2d78 P 9ead0f0623cc4f78aec63474a9ea98dc: Deleting consensus metadata
I20260807 20:21:24.432689 29031 catalog_manager.cc:4841] TS 9ead0f0623cc4f78aec63474a9ea98dc (127.30.35.194:45207): tablet 1444e1c89e5444a48cc0d5243c8e2d78 (table test-table [id=421b8f0a324d423293c559950c813472]) successfully deleted
I20260807 20:21:24.433137 29776 ts_tablet_manager.cc:1918] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 20:21:24.433212 29776 log.cc:1196] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654: Deleting WAL directory at /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786133844183963-30863-0/minicluster-data/ts-2/wal/wals/1444e1c89e5444a48cc0d5243c8e2d78
I20260807 20:21:24.433444 29776 ts_tablet_manager.cc:1939] T 1444e1c89e5444a48cc0d5243c8e2d78 P 54f327c027814460b1a7174446e12654: Deleting consensus metadata
I20260807 20:21:24.433840 29034 catalog_manager.cc:4841] TS 54f327c027814460b1a7174446e12654 (127.30.35.195:42417): tablet 1444e1c89e5444a48cc0d5243c8e2d78 (table test-table [id=421b8f0a324d423293c559950c813472]) successfully deleted
W20260807 20:21:24.436630 29032 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.30.35.193:34889 (error 108)
I20260807 20:21:24.436848 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 29320
I20260807 20:21:24.438720 29730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:24.436948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.193:34889 (local address 127.0.0.1:47082)
0807 20:21:24.438615 (+ 1667us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:24.438688 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.193:34889: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1646}
W20260807 20:21:24.438935 29032 catalog_manager.cc:4584] TS 5ef2f5a69b6a4657beea9f940ae07a5c (127.30.35.193:34889): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1444e1c89e5444a48cc0d5243c8e2d78: Network error: Client connection negotiation failed: client connection to 127.30.35.193:34889: connect: Connection refused (error 111)
I20260807 20:21:24.446215 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 29515
I20260807 20:21:24.459400 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 29007
2026-08-07T20:21:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (903 ms)
[----------] 6 tests from EncryptionPolicyTest (8990 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:24 dist-test-slave-t7g5 krb5kdc[29782](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:24 dist-test-slave-t7g5 krb5kdc[29782](info): set up 2 sockets
Aug 07 20:21:24 dist-test-slave-t7g5 krb5kdc[29782](info): commencing operation
krb5kdc: starting...
W20260807 20:21:25.605201 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:25 dist-test-slave-t7g5 krb5kdc[29782](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:21:25.725376 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33723
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33723
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:25.807690 29807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:25.807904 29807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:25.807924 29807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:25.809015 29807 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:25.809051 29807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:25.809064 29807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:25.809075 29807 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:25.809088 29807 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:25.810577 29807 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33723
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:25.810786 29807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:25.810963 29807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:25.815618 29816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:25.815662 29814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:25.815757 29807 server_base.cc:1034] running on GCE node
W20260807 20:21:25.815768 29813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:25.816179 29807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:25.816483 29807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:25.817636 29807 hybrid_clock.cc:648] HybridClock initialized: now 1786134085817622 us; error 28 us; skew 500 ppm
Aug 07 20:21:25 dist-test-slave-t7g5 krb5kdc[29782](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134085, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:25.820151 29807 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:21:25.820629 29807 webserver.cc:460] Webserver started at http://127.0.0.1:44021/ using document root <none> and password file <none>
I20260807 20:21:25.820858 29807 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:25.820916 29807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:25.821051 29807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:25.822183 29807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "ad0bcb238d944b0fb833eb40084d72df"
format_stamp: "Formatted at 2026-08-07 20:21:25 on dist-test-slave-t7g5"
server_key: "3fc9be888c4cb1d94376da738c99bc53"
server_key_iv: "089463bcfb7953b78b5673ef7fb904d7"
server_key_version: "encryptionkey@0"
I20260807 20:21:25.822541 29807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "ad0bcb238d944b0fb833eb40084d72df"
format_stamp: "Formatted at 2026-08-07 20:21:25 on dist-test-slave-t7g5"
server_key: "3fc9be888c4cb1d94376da738c99bc53"
server_key_iv: "089463bcfb7953b78b5673ef7fb904d7"
server_key_version: "encryptionkey@0"
I20260807 20:21:25.823825 29807 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:21:25.824535 29826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:25.824689 29807 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:25.824770 29807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "ad0bcb238d944b0fb833eb40084d72df"
format_stamp: "Formatted at 2026-08-07 20:21:25 on dist-test-slave-t7g5"
server_key: "3fc9be888c4cb1d94376da738c99bc53"
server_key_iv: "089463bcfb7953b78b5673ef7fb904d7"
server_key_version: "encryptionkey@0"
I20260807 20:21:25.824841 29807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:25.838795 29807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:25.840703 29807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:25.840847 29807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:25.845031 29807 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33723
I20260807 20:21:25.845072 29907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33723 every 8 connection(s)
I20260807 20:21:25.845435 29807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:25.846354 29909 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:25.848693 29909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df: Bootstrap starting.
I20260807 20:21:25.849256 29909 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:25.849498 29909 log.cc:824] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:25.850219 29909 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df: No bootstrap required, opened a new log
I20260807 20:21:25.850557 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 29807
I20260807 20:21:25.850685 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:25.850898 30863 external_mini_cluster.cc:1428] Setting key 15e394a2a6669bf3695cf059a6b39679
I20260807 20:21:25.852605 29909 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0bcb238d944b0fb833eb40084d72df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33723 } }
I20260807 20:21:25.852779 29909 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:25.852820 29909 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad0bcb238d944b0fb833eb40084d72df, State: Initialized, Role: FOLLOWER
I20260807 20:21:25.852957 29909 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0bcb238d944b0fb833eb40084d72df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33723 } }
I20260807 20:21:25.853048 29909 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:25.853087 29909 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:25.853137 29909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:25.853892 29909 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0bcb238d944b0fb833eb40084d72df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33723 } }
I20260807 20:21:25.853995 29909 leader_election.cc:302] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad0bcb238d944b0fb833eb40084d72df; no voters:
I20260807 20:21:25.854156 29909 leader_election.cc:288] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:25.854205 29915 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:25.854321 29915 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [term 1 LEADER]: Becoming Leader. State: Replica: ad0bcb238d944b0fb833eb40084d72df, State: Running, Role: LEADER
I20260807 20:21:25.854401 29915 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0bcb238d944b0fb833eb40084d72df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33723 } }
I20260807 20:21:25.854436 29909 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:25.854705 29915 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad0bcb238d944b0fb833eb40084d72df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0bcb238d944b0fb833eb40084d72df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33723 } } }
I20260807 20:21:25.854781 29915 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:25.855057 29921 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:25.854727 29917 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad0bcb238d944b0fb833eb40084d72df. Latest consensus state: current_term: 1 leader_uuid: "ad0bcb238d944b0fb833eb40084d72df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0bcb238d944b0fb833eb40084d72df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33723 } } }
I20260807 20:21:25.855253 29917 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:25.855618 29921 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:25.857717 29921 catalog_manager.cc:1347] Generated new cluster ID: f0f4c754284d43209a3fc81500b20044
I20260807 20:21:25.857772 29921 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:21:25 dist-test-slave-t7g5 krb5kdc[29782](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 20:21:25.862269 29914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:25.851457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59851 (local address 127.0.0.1:33723)
0807 20:21:25.851619 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:25.851627 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:25.851657 (+ 30us) server_negotiation.cc:407] Connection header received
0807 20:21:25.852537 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:25.852545 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:25.852599 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:25.852719 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:25.853565 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:25.854878 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:25.856054 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:25.856622 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:25.856721 (+ 99us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:25.859221 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:25.859226 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:25.859226 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:25.859239 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:25.860748 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:25.861129 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:25.861133 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:25.861133 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:25.861217 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:25.861429 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:25.861430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:25.861430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:25.861693 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:25.861867 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:25.861978 (+ 111us) server_negotiation.cc:299] Negotiation successful
0807 20:21:25.862078 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":74,"threads_started":1}
I20260807 20:21:25.862831 29921 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:25.863294 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:25.863458 29921 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:25.866889 29921 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad0bcb238d944b0fb833eb40084d72df: Generated new TSK 0
I20260807 20:21:25.867049 29921 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:25.873057 29914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:25.864727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50801 (local address 127.0.0.1:33723)
0807 20:21:25.864767 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:25.864769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:25.864911 (+ 142us) server_negotiation.cc:407] Connection header received
0807 20:21:25.864952 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:25.864953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:25.864964 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:25.865018 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:25.865568 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:25.866366 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:25.867366 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:25.867664 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:25.867701 (+ 37us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:25.870632 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:25.870633 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:25.870633 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:25.870641 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:25.872017 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:25.872344 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:25.872345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:25.872346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:25.872404 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:25.872583 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:25.872584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:25.872584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:25.872706 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:25.872800 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:25.872905 (+ 105us) server_negotiation.cc:299] Negotiation successful
0807 20:21:25.872966 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 20:21:25.875070 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 29807
W20260807 20:21:25.891260 29780 connection.cc:535] client connection to 127.0.0.1:33723 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33723): Connection reset by peer (error 104)
2026-08-07T20:21:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1416 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:25 dist-test-slave-t7g5 krb5kdc[29951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:25 dist-test-slave-t7g5 krb5kdc[29951](info): set up 2 sockets
Aug 07 20:21:25 dist-test-slave-t7g5 krb5kdc[29951](info): commencing operation
krb5kdc: starting...
W20260807 20:21:27.027747 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:27 dist-test-slave-t7g5 krb5kdc[29951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134087, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:21:27.148913 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41337
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:27.231190 29970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:27.231418 29970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:27.231458 29970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:27.232609 29970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:27.232650 29970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:27.232669 29970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:27.232684 29970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:27.232700 29970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:27.234258 29970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41337
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29970
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:27.234527 29970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:27.234732 29970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:27.239339 29983 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:27.239337 29980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:27.239339 29978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:27.239463 29970 server_base.cc:1034] running on GCE node
I20260807 20:21:27.239851 29970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:27.240154 29970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:27.241303 29970 hybrid_clock.cc:648] HybridClock initialized: now 1786134087241281 us; error 36 us; skew 500 ppm
Aug 07 20:21:27 dist-test-slave-t7g5 krb5kdc[29951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134087, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:27.243722 29970 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:21:27.244146 29970 webserver.cc:460] Webserver started at http://127.0.0.1:46409/ using document root <none> and password file <none>
I20260807 20:21:27.244346 29970 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:27.244405 29970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:27.244532 29970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:27.245591 29970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "d9e2e1f438544070adee03705a7a3261"
format_stamp: "Formatted at 2026-08-07 20:21:27 on dist-test-slave-t7g5"
server_key: "14651b1b357a852ab5f10acc664d5e7e"
server_key_iv: "97ad6a85a90c28eb3a98a8613d034bfa"
server_key_version: "encryptionkey@0"
I20260807 20:21:27.245975 29970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "d9e2e1f438544070adee03705a7a3261"
format_stamp: "Formatted at 2026-08-07 20:21:27 on dist-test-slave-t7g5"
server_key: "14651b1b357a852ab5f10acc664d5e7e"
server_key_iv: "97ad6a85a90c28eb3a98a8613d034bfa"
server_key_version: "encryptionkey@0"
I20260807 20:21:27.247215 29970 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:21:27.247881 29994 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:27.248032 29970 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:27.248118 29970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "d9e2e1f438544070adee03705a7a3261"
format_stamp: "Formatted at 2026-08-07 20:21:27 on dist-test-slave-t7g5"
server_key: "14651b1b357a852ab5f10acc664d5e7e"
server_key_iv: "97ad6a85a90c28eb3a98a8613d034bfa"
server_key_version: "encryptionkey@0"
I20260807 20:21:27.248184 29970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:27.267851 29970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:27.269582 29970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:27.269743 29970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:27.273383 29970 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41337
I20260807 20:21:27.273432 30079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41337 every 8 connection(s)
I20260807 20:21:27.273813 29970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:27.274685 30080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:27.276991 30080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261: Bootstrap starting.
I20260807 20:21:27.277524 30080 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:27.277781 30080 log.cc:824] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:27.278415 30080 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261: No bootstrap required, opened a new log
I20260807 20:21:27.279912 30080 raft_consensus.cc:348] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9e2e1f438544070adee03705a7a3261" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41337 } }
I20260807 20:21:27.280064 30080 raft_consensus.cc:374] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:27.280087 30080 raft_consensus.cc:729] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9e2e1f438544070adee03705a7a3261, State: Initialized, Role: FOLLOWER
I20260807 20:21:27.280195 30080 consensus_queue.cc:260] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9e2e1f438544070adee03705a7a3261" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41337 } }
I20260807 20:21:27.280246 30080 raft_consensus.cc:388] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:27.280264 30080 raft_consensus.cc:482] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:27.280293 30080 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:27.280771 30080 raft_consensus.cc:504] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9e2e1f438544070adee03705a7a3261" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41337 } }
I20260807 20:21:27.280856 30080 leader_election.cc:302] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d9e2e1f438544070adee03705a7a3261; no voters:
I20260807 20:21:27.280990 30080 leader_election.cc:288] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:27.281039 30083 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:27.281214 30080 sys_catalog.cc:564] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:27.281219 30083 raft_consensus.cc:686] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [term 1 LEADER]: Becoming Leader. State: Replica: d9e2e1f438544070adee03705a7a3261, State: Running, Role: LEADER
I20260807 20:21:27.281337 30083 consensus_queue.cc:237] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9e2e1f438544070adee03705a7a3261" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41337 } }
I20260807 20:21:27.281888 30086 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9e2e1f438544070adee03705a7a3261. Latest consensus state: current_term: 1 leader_uuid: "d9e2e1f438544070adee03705a7a3261" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9e2e1f438544070adee03705a7a3261" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41337 } } }
I20260807 20:21:27.282208 30085 sys_catalog.cc:455] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9e2e1f438544070adee03705a7a3261" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9e2e1f438544070adee03705a7a3261" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41337 } } }
I20260807 20:21:27.282305 30086 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:27.282369 30085 sys_catalog.cc:458] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:27.282622 30100 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:27.283116 30100 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:27.283856 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 29970
I20260807 20:21:27.283993 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:27.284195 30863 external_mini_cluster.cc:1428] Setting key 3e4f31311f50af009fdb20e64c677454
I20260807 20:21:27.284611 30100 catalog_manager.cc:1347] Generated new cluster ID: 4cf0ce06a11c4c8db02656c54abfa9ca
I20260807 20:21:27.284663 30100 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:27.290818 30100 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:27.291273 30115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:27.284866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51131 (local address 127.0.0.1:41337)
0807 20:21:27.285778 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:27.285788 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:27.285826 (+ 38us) server_negotiation.cc:407] Connection header received
0807 20:21:27.285958 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:27.285965 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:27.286029 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:27.286175 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:27.286403 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:27.287824 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:27.288920 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:27.289600 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:27.289753 (+ 153us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:27.290455 (+ 702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:27.290459 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:27.290460 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:27.290671 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:27.290705 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:27.290717 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:27.290791 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:27.291031 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 20:21:27.291064 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":858,"thread_start_us":61,"threads_started":1}
I20260807 20:21:27.291389 30100 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:27.292217 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:27.297011 30115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:27.293629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43619 (local address 127.0.0.1:41337)
0807 20:21:27.293704 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:27.293706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:27.293809 (+ 103us) server_negotiation.cc:407] Connection header received
0807 20:21:27.293867 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:27.293868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:27.293877 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:27.293926 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:27.294065 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:27.294785 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:27.295815 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:27.296119 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:27.296169 (+ 50us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:27.296788 (+ 619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:27.296789 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:27.296789 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:27.296793 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:27.296806 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:27.296810 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:27.296859 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:27.296927 (+ 68us) server_negotiation.cc:299] Negotiation successful
0807 20:21:27.296939 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 20:21:27.306123 30100 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d9e2e1f438544070adee03705a7a3261: Generated new TSK 0
I20260807 20:21:27.306304 30100 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:27.312640 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 29970
W20260807 20:21:27.326890 29948 connection.cc:535] client connection to 127.0.0.1:41337 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41337): Connection reset by peer (error 104)
2026-08-07T20:21:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1435 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:27 dist-test-slave-t7g5 krb5kdc[30125](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:27 dist-test-slave-t7g5 krb5kdc[30125](info): set up 2 sockets
Aug 07 20:21:27 dist-test-slave-t7g5 krb5kdc[30125](info): commencing operation
krb5kdc: starting...
W20260807 20:21:28.457922 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.117s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:28 dist-test-slave-t7g5 krb5kdc[30125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:21:28.576277 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45339
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:28.656700 30141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:28.656911 30141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:28.656941 30141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:28.658110 30141 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:28.658154 30141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:28.658171 30141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:28.658187 30141 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:28.658202 30141 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:28.659642 30141 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45339
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:28.659883 30141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:28.660094 30141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:28.666023 30149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:28.666052 30154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:28.666079 30151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:28.666283 30141 server_base.cc:1034] running on GCE node
I20260807 20:21:28.666534 30141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:28.666795 30141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:28.667940 30141 hybrid_clock.cc:648] HybridClock initialized: now 1786134088667927 us; error 30 us; skew 500 ppm
Aug 07 20:21:28 dist-test-slave-t7g5 krb5kdc[30125](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134088, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:28.675431 30141 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:21:28.675882 30141 webserver.cc:460] Webserver started at http://127.0.0.1:36859/ using document root <none> and password file <none>
I20260807 20:21:28.676067 30141 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:28.676105 30141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:28.676196 30141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:28.677192 30141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "9493c741bd0a4ab3a8ab29cc25a4f0a6"
format_stamp: "Formatted at 2026-08-07 20:21:28 on dist-test-slave-t7g5"
server_key: "532aec1fbde1c0c0f2b25c7f771ec22c"
server_key_iv: "2e73097ba255b5a7f12fc2f200405103"
server_key_version: "encryptionkey@0"
I20260807 20:21:28.677498 30141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "9493c741bd0a4ab3a8ab29cc25a4f0a6"
format_stamp: "Formatted at 2026-08-07 20:21:28 on dist-test-slave-t7g5"
server_key: "532aec1fbde1c0c0f2b25c7f771ec22c"
server_key_iv: "2e73097ba255b5a7f12fc2f200405103"
server_key_version: "encryptionkey@0"
I20260807 20:21:28.678743 30141 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:21:28.679381 30166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:28.679558 30141 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:28.679636 30141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "9493c741bd0a4ab3a8ab29cc25a4f0a6"
format_stamp: "Formatted at 2026-08-07 20:21:28 on dist-test-slave-t7g5"
server_key: "532aec1fbde1c0c0f2b25c7f771ec22c"
server_key_iv: "2e73097ba255b5a7f12fc2f200405103"
server_key_version: "encryptionkey@0"
I20260807 20:21:28.679706 30141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:28.683009 30141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:28.685022 30141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:28.685148 30141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:28.688879 30141 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45339
I20260807 20:21:28.688923 30248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45339 every 8 connection(s)
I20260807 20:21:28.689208 30141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:28.690227 30249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:28.690762 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 30141
I20260807 20:21:28.690848 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:28.691037 30863 external_mini_cluster.cc:1428] Setting key 7900c63597cbeaead89876555d34e806
I20260807 20:21:28.692866 30249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6: Bootstrap starting.
I20260807 20:21:28.693166 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:28.691495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41455 (local address 127.0.0.1:45339)
0807 20:21:28.691646 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:28.691654 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:28.691677 (+ 23us) server_negotiation.cc:407] Connection header received
0807 20:21:28.692068 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:28.692074 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:28.692099 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:28.692207 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:28.692776 (+ 569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:28.692779 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:28.692780 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:28.692783 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:28.692817 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:28.692827 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:28.692877 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:28.692990 (+ 113us) server_negotiation.cc:299] Negotiation successful
0807 20:21:28.693029 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":63,"threads_started":1}
I20260807 20:21:28.693531 30249 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:28.693847 30249 log.cc:824] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:28.694111 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:28.694610 30249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6: No bootstrap required, opened a new log
I20260807 20:21:28.696455 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:28.695602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49691 (local address 127.0.0.1:45339)
0807 20:21:28.695640 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:28.695641 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:28.695710 (+ 69us) server_negotiation.cc:407] Connection header received
0807 20:21:28.695753 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:28.695754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:28.695758 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:28.695821 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:28.696271 (+ 450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:28.696272 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:28.696273 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:28.696277 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:28.696291 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:28.696294 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:28.696348 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:28.696381 (+ 33us) server_negotiation.cc:299] Negotiation successful
0807 20:21:28.696392 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:21:28.696972 30249 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9493c741bd0a4ab3a8ab29cc25a4f0a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45339 } }
I20260807 20:21:28.697098 30249 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:28.697118 30249 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9493c741bd0a4ab3a8ab29cc25a4f0a6, State: Initialized, Role: FOLLOWER
I20260807 20:21:28.697227 30249 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9493c741bd0a4ab3a8ab29cc25a4f0a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45339 } }
I20260807 20:21:28.697300 30249 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:28.697332 30249 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:28.697377 30249 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:28.697942 30249 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9493c741bd0a4ab3a8ab29cc25a4f0a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45339 } }
I20260807 20:21:28.698040 30249 leader_election.cc:302] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9493c741bd0a4ab3a8ab29cc25a4f0a6; no voters:
I20260807 20:21:28.698195 30249 leader_election.cc:288] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:28.698244 30267 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:28.698400 30267 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 9493c741bd0a4ab3a8ab29cc25a4f0a6, State: Running, Role: LEADER
I20260807 20:21:28.698433 30249 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:28.698558 30267 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9493c741bd0a4ab3a8ab29cc25a4f0a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45339 } }
I20260807 20:21:28.698943 30268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9493c741bd0a4ab3a8ab29cc25a4f0a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9493c741bd0a4ab3a8ab29cc25a4f0a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45339 } } }
I20260807 20:21:28.699013 30269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9493c741bd0a4ab3a8ab29cc25a4f0a6. Latest consensus state: current_term: 1 leader_uuid: "9493c741bd0a4ab3a8ab29cc25a4f0a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9493c741bd0a4ab3a8ab29cc25a4f0a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45339 } } }
I20260807 20:21:28.699183 30269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:28.699522 30276 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:28.699607 30268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:28.699944 30276 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:28.701282 30276 catalog_manager.cc:1347] Generated new cluster ID: 7976800505f44980ade83ae107bbb96a
I20260807 20:21:28.701327 30276 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:28.718333 30276 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:28.718495 30276 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:28.726477 30276 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9493c741bd0a4ab3a8ab29cc25a4f0a6: Generated new TSK 0
I20260807 20:21:28.726681 30276 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:28.735148 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 30141
2026-08-07T20:21:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1419 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:28 dist-test-slave-t7g5 krb5kdc[30295](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:28 dist-test-slave-t7g5 krb5kdc[30295](info): set up 2 sockets
Aug 07 20:21:28 dist-test-slave-t7g5 krb5kdc[30295](info): commencing operation
krb5kdc: starting...
W20260807 20:21:29.874392 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:29 dist-test-slave-t7g5 krb5kdc[30295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134089, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:21:29.995980 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44479
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44479
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:30.077030 30320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:30.077239 30320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:30.077268 30320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:30.078414 30320 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:30.078456 30320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:30.078476 30320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:30.078492 30320 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:30.078507 30320 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:30.079941 30320 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44479
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44479
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:30.080180 30320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:30.080379 30320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:30.085135 30330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:30.085117 30326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:30.085110 30327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:30.085299 30320 server_base.cc:1034] running on GCE node
I20260807 20:21:30.085614 30320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:30.085897 30320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:30.087034 30320 hybrid_clock.cc:648] HybridClock initialized: now 1786134090087015 us; error 35 us; skew 500 ppm
Aug 07 20:21:30 dist-test-slave-t7g5 krb5kdc[30295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134090, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:30.089399 30320 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:21:30.089839 30320 webserver.cc:460] Webserver started at http://127.0.0.1:39443/ using document root <none> and password file <none>
I20260807 20:21:30.090029 30320 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:30.090091 30320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:30.090204 30320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:30.091212 30320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "31a868fe5f8b4e4fadf0fbd0a29db361"
format_stamp: "Formatted at 2026-08-07 20:21:30 on dist-test-slave-t7g5"
server_key: "52d556a4e797d893c3f0e334a062a77c"
server_key_iv: "6c31c00ac511ba74928fcc3c60dde147"
server_key_version: "encryptionkey@0"
I20260807 20:21:30.091543 30320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "31a868fe5f8b4e4fadf0fbd0a29db361"
format_stamp: "Formatted at 2026-08-07 20:21:30 on dist-test-slave-t7g5"
server_key: "52d556a4e797d893c3f0e334a062a77c"
server_key_iv: "6c31c00ac511ba74928fcc3c60dde147"
server_key_version: "encryptionkey@0"
I20260807 20:21:30.092744 30320 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:21:30.093415 30340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:30.093571 30320 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:30.093647 30320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "31a868fe5f8b4e4fadf0fbd0a29db361"
format_stamp: "Formatted at 2026-08-07 20:21:30 on dist-test-slave-t7g5"
server_key: "52d556a4e797d893c3f0e334a062a77c"
server_key_iv: "6c31c00ac511ba74928fcc3c60dde147"
server_key_version: "encryptionkey@0"
I20260807 20:21:30.093729 30320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:30.100446 30320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:30.102113 30320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:30.102243 30320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:30.105996 30320 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44479
I20260807 20:21:30.106029 30420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44479 every 8 connection(s)
I20260807 20:21:30.106359 30320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:30.107219 30421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:30.109459 30421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361: Bootstrap starting.
I20260807 20:21:30.110046 30421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:30.110320 30421 log.cc:824] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:30.110468 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 30320
I20260807 20:21:30.110595 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:30.110770 30863 external_mini_cluster.cc:1428] Setting key 78ff7c8ecdbdf2b9e9dac91e8a488d56
I20260807 20:21:30.111104 30421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361: No bootstrap required, opened a new log
I20260807 20:21:30.112986 30421 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a868fe5f8b4e4fadf0fbd0a29db361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44479 } }
I20260807 20:21:30.113132 30421 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:30.113154 30421 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a868fe5f8b4e4fadf0fbd0a29db361, State: Initialized, Role: FOLLOWER
I20260807 20:21:30.113274 30421 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a868fe5f8b4e4fadf0fbd0a29db361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44479 } }
I20260807 20:21:30.113358 30421 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:30.113408 30421 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:30.113453 30421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:30.114209 30421 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a868fe5f8b4e4fadf0fbd0a29db361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44479 } }
I20260807 20:21:30.114323 30421 leader_election.cc:302] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31a868fe5f8b4e4fadf0fbd0a29db361; no voters:
I20260807 20:21:30.114490 30421 leader_election.cc:288] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:30.114523 30428 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:30.114672 30428 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [term 1 LEADER]: Becoming Leader. State: Replica: 31a868fe5f8b4e4fadf0fbd0a29db361, State: Running, Role: LEADER
I20260807 20:21:30.114723 30421 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:30.115783 30428 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a868fe5f8b4e4fadf0fbd0a29db361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44479 } }
I20260807 20:21:30.116456 30430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31a868fe5f8b4e4fadf0fbd0a29db361" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a868fe5f8b4e4fadf0fbd0a29db361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44479 } } }
I20260807 20:21:30.116565 30430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:30.116593 30429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31a868fe5f8b4e4fadf0fbd0a29db361. Latest consensus state: current_term: 1 leader_uuid: "31a868fe5f8b4e4fadf0fbd0a29db361" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a868fe5f8b4e4fadf0fbd0a29db361" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44479 } } }
I20260807 20:21:30.116669 30429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361 [sys.catalog]: This master's current role is: LEADER
W20260807 20:21:30.117390 30446 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:21:30.117439 30446 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:21:30.117499 30447 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:30.117741 30447 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 20:21:30 dist-test-slave-t7g5 krb5kdc[30295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134089, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 20:21:30.120097 30447 catalog_manager.cc:1347] Generated new cluster ID: a66901a443d848168161a9e2fc11d678
I20260807 20:21:30.120157 30447 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:30.122831 30425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:30.111255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60835 (local address 127.0.0.1:44479)
0807 20:21:30.111471 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:30.111480 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:30.111505 (+ 25us) server_negotiation.cc:407] Connection header received
0807 20:21:30.112364 (+ 859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:30.112373 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:30.112428 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:30.112572 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:30.113246 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:30.114927 (+ 1681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:30.115807 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:30.116430 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:30.116537 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:30.119475 (+ 2938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:30.119479 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:30.119479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:30.119493 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:30.121146 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:30.121501 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:30.121504 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:30.121505 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:30.121595 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:30.121803 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:30.121804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:30.121804 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:30.122052 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:30.122197 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:30.122309 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 20:21:30.122477 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":85,"threads_started":1}
I20260807 20:21:30.123749 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:30.129622 30447 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:30.130359 30447 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:30.130919 30425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:30.125057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41549 (local address 127.0.0.1:44479)
0807 20:21:30.125092 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:30.125093 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:30.125201 (+ 108us) server_negotiation.cc:407] Connection header received
0807 20:21:30.125253 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:30.125254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:30.125264 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:30.125307 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:30.125830 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:30.126306 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:30.126992 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:30.127224 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:30.127280 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:30.128392 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:30.128393 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:30.128394 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:30.128401 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:30.129878 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:30.130195 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:30.130196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:30.130196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:30.130257 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:30.130425 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:30.130426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:30.130427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:30.130552 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:30.130654 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:30.130747 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 20:21:30.130833 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 20:21:30.139442 30447 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31a868fe5f8b4e4fadf0fbd0a29db361: Generated new TSK 0
I20260807 20:21:30.139648 30447 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:30.143039 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 30320
2026-08-07T20:21:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1412 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:30 dist-test-slave-t7g5 krb5kdc[30465](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:30 dist-test-slave-t7g5 krb5kdc[30465](info): set up 2 sockets
Aug 07 20:21:30 dist-test-slave-t7g5 krb5kdc[30465](info): commencing operation
krb5kdc: starting...
W20260807 20:21:31.304834 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:31 dist-test-slave-t7g5 krb5kdc[30465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:21:31.424634 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46575
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39445
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46575
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:31.508304 30482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:31.508558 30482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:31.508592 30482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:31.510272 30482 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:31.510330 30482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:31.510349 30482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:31.510365 30482 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:31.510381 30482 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:31.512492 30482 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39445
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46575
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:31.512758 30482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:31.513005 30482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:31.517894 30496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:31.517892 30491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:31.518121 30482 server_base.cc:1034] running on GCE node
W20260807 20:21:31.518265 30493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:31.518502 30482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:31.518819 30482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:31.519976 30482 hybrid_clock.cc:648] HybridClock initialized: now 1786134091519955 us; error 34 us; skew 500 ppm
Aug 07 20:21:31 dist-test-slave-t7g5 krb5kdc[30465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134091, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:31.523072 30482 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:21:31.523574 30482 webserver.cc:460] Webserver started at http://127.0.0.1:37221/ using document root <none> and password file <none>
I20260807 20:21:31.523825 30482 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:31.523890 30482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:31.524021 30482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:31.525549 30482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "859cd6599f8b45c9b98cb53cbdfd2a76"
format_stamp: "Formatted at 2026-08-07 20:21:31 on dist-test-slave-t7g5"
server_key: "912695cf8f767547442ecb10abe611eb"
server_key_iv: "ddb030e55bc0b18c4ec08649481b54c5"
server_key_version: "encryptionkey@0"
I20260807 20:21:31.526135 30482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "859cd6599f8b45c9b98cb53cbdfd2a76"
format_stamp: "Formatted at 2026-08-07 20:21:31 on dist-test-slave-t7g5"
server_key: "912695cf8f767547442ecb10abe611eb"
server_key_iv: "ddb030e55bc0b18c4ec08649481b54c5"
server_key_version: "encryptionkey@0"
I20260807 20:21:31.528033 30482 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260807 20:21:31.528873 30509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:31.529042 30482 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:31.529134 30482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "859cd6599f8b45c9b98cb53cbdfd2a76"
format_stamp: "Formatted at 2026-08-07 20:21:31 on dist-test-slave-t7g5"
server_key: "912695cf8f767547442ecb10abe611eb"
server_key_iv: "ddb030e55bc0b18c4ec08649481b54c5"
server_key_version: "encryptionkey@0"
I20260807 20:21:31.529208 30482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:31.543856 30482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:31.546130 30482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:31.546268 30482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:31.550803 30482 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46575
I20260807 20:21:31.550850 30588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46575 every 8 connection(s)
I20260807 20:21:31.551182 30482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:31.552222 30589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:31.555585 30589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76: Bootstrap starting.
I20260807 20:21:31.556336 30589 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:31.556705 30589 log.cc:824] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:31.557497 30589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76: No bootstrap required, opened a new log
I20260807 20:21:31.560060 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 30482
I20260807 20:21:31.559968 30589 raft_consensus.cc:348] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "859cd6599f8b45c9b98cb53cbdfd2a76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46575 } }
I20260807 20:21:31.560150 30589 raft_consensus.cc:374] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:31.560171 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:31.560196 30589 raft_consensus.cc:729] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 859cd6599f8b45c9b98cb53cbdfd2a76, State: Initialized, Role: FOLLOWER
I20260807 20:21:31.560367 30863 external_mini_cluster.cc:1428] Setting key bb0cbfe5a55c5f6d6e04e13a81cc3bc1
I20260807 20:21:31.560352 30589 consensus_queue.cc:260] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "859cd6599f8b45c9b98cb53cbdfd2a76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46575 } }
I20260807 20:21:31.560425 30589 raft_consensus.cc:388] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:31.560475 30589 raft_consensus.cc:482] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:31.560527 30589 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:31.561185 30589 raft_consensus.cc:504] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "859cd6599f8b45c9b98cb53cbdfd2a76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46575 } }
I20260807 20:21:31.561318 30589 leader_election.cc:302] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 859cd6599f8b45c9b98cb53cbdfd2a76; no voters:
I20260807 20:21:31.561509 30589 leader_election.cc:288] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:31.561532 30594 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:31.561642 30594 raft_consensus.cc:686] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [term 1 LEADER]: Becoming Leader. State: Replica: 859cd6599f8b45c9b98cb53cbdfd2a76, State: Running, Role: LEADER
I20260807 20:21:31.561759 30594 consensus_queue.cc:237] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "859cd6599f8b45c9b98cb53cbdfd2a76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46575 } }
I20260807 20:21:31.561810 30589 sys_catalog.cc:564] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:31.562165 30598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "859cd6599f8b45c9b98cb53cbdfd2a76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "859cd6599f8b45c9b98cb53cbdfd2a76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46575 } } }
I20260807 20:21:31.562268 30598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:31.562467 30603 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:31.562469 30595 sys_catalog.cc:455] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 859cd6599f8b45c9b98cb53cbdfd2a76. Latest consensus state: current_term: 1 leader_uuid: "859cd6599f8b45c9b98cb53cbdfd2a76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "859cd6599f8b45c9b98cb53cbdfd2a76" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46575 } } }
I20260807 20:21:31.562664 30595 sys_catalog.cc:458] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:31.563053 30603 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:31.564870 30603 catalog_manager.cc:1347] Generated new cluster ID: 8903f0c382c04c34a97cecdaba4cb8ff
I20260807 20:21:31.564922 30603 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:31.566433 30593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:31.560800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55949 (local address 127.0.0.1:46575)
0807 20:21:31.561371 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:31.561380 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:31.561415 (+ 35us) server_negotiation.cc:407] Connection header received
0807 20:21:31.561525 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:31.561530 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:31.561582 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:31.561985 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:31.562091 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:31.563547 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:31.564496 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:31.565073 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:31.565170 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:31.565797 (+ 627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:31.565800 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:31.565801 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:31.565978 (+ 177us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:31.566008 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:31.566019 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:31.566074 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:31.566157 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 20:21:31.566218 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":440,"threads_started":1}
I20260807 20:21:31.567235 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:31.571270 30593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:31.568467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47085 (local address 127.0.0.1:46575)
0807 20:21:31.568502 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:31.568505 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:31.568630 (+ 125us) server_negotiation.cc:407] Connection header received
0807 20:21:31.568681 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:31.568682 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:31.568693 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:31.568733 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:31.568867 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:31.569567 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:31.570274 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:31.570476 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:31.570529 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:31.571062 (+ 533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:31.571063 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:31.571063 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:31.571068 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:31.571082 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:31.571086 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:31.571127 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:31.571175 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 20:21:31.571197 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 20:21:31.588946 30603 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:31.589478 30603 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:31.594640 30603 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 859cd6599f8b45c9b98cb53cbdfd2a76: Generated new TSK 0
I20260807 20:21:31.594811 30603 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:31.601424 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 30482
2026-08-07T20:21:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1450 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:31 dist-test-slave-t7g5 krb5kdc[30638](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:31 dist-test-slave-t7g5 krb5kdc[30638](info): set up 2 sockets
Aug 07 20:21:31 dist-test-slave-t7g5 krb5kdc[30638](info): commencing operation
krb5kdc: starting...
W20260807 20:21:32.729561 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:32 dist-test-slave-t7g5 krb5kdc[30638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134092, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:21:32.845181 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37607
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46023
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37607
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:32.926963 30665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:32.927170 30665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:32.927201 30665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:32.928333 30665 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:32.928376 30665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:32.928395 30665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:32.928411 30665 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:32.928426 30665 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:32.929965 30665 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46023
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:32.930226 30665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:32.930435 30665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:32.935024 30673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:32.935053 30672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:32.935030 30675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:32.935140 30665 server_base.cc:1034] running on GCE node
I20260807 20:21:32.935498 30665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:32.935783 30665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:32.936939 30665 hybrid_clock.cc:648] HybridClock initialized: now 1786134092936915 us; error 33 us; skew 500 ppm
Aug 07 20:21:32 dist-test-slave-t7g5 krb5kdc[30638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134092, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:32.939440 30665 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:21:32.939824 30665 webserver.cc:460] Webserver started at http://127.0.0.1:46559/ using document root <none> and password file <none>
I20260807 20:21:32.940008 30665 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:32.940047 30665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:32.940140 30665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:32.941188 30665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "42af3a8c7c0948b4858be11a35236f9b"
format_stamp: "Formatted at 2026-08-07 20:21:32 on dist-test-slave-t7g5"
server_key: "e9498f43049f5ccf63c400ce4bbd0a6b"
server_key_iv: "eabb463b60d464f2342ce518b8944a6d"
server_key_version: "encryptionkey@0"
I20260807 20:21:32.941490 30665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "42af3a8c7c0948b4858be11a35236f9b"
format_stamp: "Formatted at 2026-08-07 20:21:32 on dist-test-slave-t7g5"
server_key: "e9498f43049f5ccf63c400ce4bbd0a6b"
server_key_iv: "eabb463b60d464f2342ce518b8944a6d"
server_key_version: "encryptionkey@0"
I20260807 20:21:32.942766 30665 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:21:32.943490 30684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:32.943686 30665 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:21:32.943773 30665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "42af3a8c7c0948b4858be11a35236f9b"
format_stamp: "Formatted at 2026-08-07 20:21:32 on dist-test-slave-t7g5"
server_key: "e9498f43049f5ccf63c400ce4bbd0a6b"
server_key_iv: "eabb463b60d464f2342ce518b8944a6d"
server_key_version: "encryptionkey@0"
I20260807 20:21:32.943848 30665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:32.947062 30665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:32.949010 30665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:32.949119 30665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:32.953114 30665 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37607
I20260807 20:21:32.953146 30774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37607 every 8 connection(s)
I20260807 20:21:32.953440 30665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:32.954439 30776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:32.956576 30776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b: Bootstrap starting.
I20260807 20:21:32.957082 30776 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:32.957305 30776 log.cc:824] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:32.957971 30776 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b: No bootstrap required, opened a new log
I20260807 20:21:32.959551 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 30665
I20260807 20:21:32.959677 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:32.959731 30776 raft_consensus.cc:348] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42af3a8c7c0948b4858be11a35236f9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37607 } }
I20260807 20:21:32.959885 30863 external_mini_cluster.cc:1428] Setting key c363a5692eb576e549ee2ae461972041
I20260807 20:21:32.959909 30776 raft_consensus.cc:374] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:32.959954 30776 raft_consensus.cc:729] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42af3a8c7c0948b4858be11a35236f9b, State: Initialized, Role: FOLLOWER
I20260807 20:21:32.960095 30776 consensus_queue.cc:260] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42af3a8c7c0948b4858be11a35236f9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37607 } }
I20260807 20:21:32.960180 30776 raft_consensus.cc:388] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:32.960212 30776 raft_consensus.cc:482] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:32.960254 30776 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:32.961107 30776 raft_consensus.cc:504] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42af3a8c7c0948b4858be11a35236f9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37607 } }
I20260807 20:21:32.961215 30776 leader_election.cc:302] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 42af3a8c7c0948b4858be11a35236f9b; no voters:
I20260807 20:21:32.961383 30776 leader_election.cc:288] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:32.961439 30787 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:32.961581 30787 raft_consensus.cc:686] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [term 1 LEADER]: Becoming Leader. State: Replica: 42af3a8c7c0948b4858be11a35236f9b, State: Running, Role: LEADER
I20260807 20:21:32.961623 30776 sys_catalog.cc:564] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:32.961695 30787 consensus_queue.cc:237] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42af3a8c7c0948b4858be11a35236f9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37607 } }
I20260807 20:21:32.962049 30787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "42af3a8c7c0948b4858be11a35236f9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42af3a8c7c0948b4858be11a35236f9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37607 } } }
I20260807 20:21:32.962149 30787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:32.962213 30784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:32.960341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48429 (local address 127.0.0.1:37607)
0807 20:21:32.960591 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:32.960599 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:32.960622 (+ 23us) server_negotiation.cc:407] Connection header received
0807 20:21:32.960726 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:32.960731 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:32.960753 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:32.960850 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:32.961509 (+ 659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:32.961513 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:32.961513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:32.961518 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:32.961566 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:32.961581 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:32.961647 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:32.961928 (+ 281us) server_negotiation.cc:299] Negotiation successful
0807 20:21:32.961971 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":118,"threads_started":1}
I20260807 20:21:32.962281 30787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 42af3a8c7c0948b4858be11a35236f9b. Latest consensus state: current_term: 1 leader_uuid: "42af3a8c7c0948b4858be11a35236f9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "42af3a8c7c0948b4858be11a35236f9b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37607 } } }
I20260807 20:21:32.962333 30787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:32.962445 30800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:32.963215 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:32.963249 30800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:32.964830 30800 catalog_manager.cc:1347] Generated new cluster ID: f04ca265bb5b4327b9e8b8c53955dca9
I20260807 20:21:32.964885 30800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:32.965673 30784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:32.964690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32925 (local address 127.0.0.1:37607)
0807 20:21:32.964724 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:32.964726 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:32.964827 (+ 101us) server_negotiation.cc:407] Connection header received
0807 20:21:32.964944 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:32.964945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:32.964951 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:32.964997 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:32.965476 (+ 479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:32.965477 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:32.965477 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:32.965481 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:32.965495 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:32.965499 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:32.965543 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:32.965584 (+ 41us) server_negotiation.cc:299] Negotiation successful
0807 20:21:32.965596 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 20:21:33.002121 30800 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:33.002321 30800 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:33.007678 30800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 42af3a8c7c0948b4858be11a35236f9b: Generated new TSK 0
I20260807 20:21:33.007882 30800 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:33.011162 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 30665
2026-08-07T20:21:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1414 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:33 dist-test-slave-t7g5 krb5kdc[30826](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:33 dist-test-slave-t7g5 krb5kdc[30826](info): set up 2 sockets
Aug 07 20:21:33 dist-test-slave-t7g5 krb5kdc[30826](info): commencing operation
krb5kdc: starting...
W20260807 20:21:34.158303 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:34 dist-test-slave-t7g5 krb5kdc[30826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134094, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:21:34.278461 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37187
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43879
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37187
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:34.360591 30846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:34.360803 30846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:34.360824 30846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:34.361974 30846 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:34.362016 30846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:34.362030 30846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:34.362051 30846 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:34.362068 30846 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:34.363566 30846 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43879
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37187
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:34.363793 30846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:34.364001 30846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:34.368583 30854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:34.368599 30852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:34.368590 30857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:34.368867 30846 server_base.cc:1034] running on GCE node
I20260807 20:21:34.369112 30846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:34.369382 30846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:34.370517 30846 hybrid_clock.cc:648] HybridClock initialized: now 1786134094370507 us; error 38 us; skew 500 ppm
Aug 07 20:21:34 dist-test-slave-t7g5 krb5kdc[30826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134094, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:34.378551 30846 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:21:34.378998 30846 webserver.cc:460] Webserver started at http://127.0.0.1:38585/ using document root <none> and password file <none>
I20260807 20:21:34.379211 30846 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:34.379253 30846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:34.379354 30846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:34.380422 30846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "8b1abff9307445c2adad31a162f1cd5a"
format_stamp: "Formatted at 2026-08-07 20:21:34 on dist-test-slave-t7g5"
server_key: "c0e56c59abeff98bd7817b2e18cf2389"
server_key_iv: "8595f8ef571e9e9f09754eceec49e66c"
server_key_version: "encryptionkey@0"
I20260807 20:21:34.380950 30846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "8b1abff9307445c2adad31a162f1cd5a"
format_stamp: "Formatted at 2026-08-07 20:21:34 on dist-test-slave-t7g5"
server_key: "c0e56c59abeff98bd7817b2e18cf2389"
server_key_iv: "8595f8ef571e9e9f09754eceec49e66c"
server_key_version: "encryptionkey@0"
I20260807 20:21:34.382320 30846 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:21:34.383037 30869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:34.383195 30846 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:34.383279 30846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "8b1abff9307445c2adad31a162f1cd5a"
format_stamp: "Formatted at 2026-08-07 20:21:34 on dist-test-slave-t7g5"
server_key: "c0e56c59abeff98bd7817b2e18cf2389"
server_key_iv: "8595f8ef571e9e9f09754eceec49e66c"
server_key_version: "encryptionkey@0"
I20260807 20:21:34.383345 30846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:34.393775 30846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:34.395839 30846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:34.395970 30846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:34.399682 30846 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37187
I20260807 20:21:34.399731 30950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37187 every 8 connection(s)
I20260807 20:21:34.400058 30846 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:34.400884 30953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:34.403200 30953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a: Bootstrap starting.
I20260807 20:21:34.403715 30953 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:34.403945 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 30846
I20260807 20:21:34.404058 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:34.404044 30953 log.cc:824] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:34.404271 30863 external_mini_cluster.cc:1428] Setting key eacf467381c5d3a1fdab510432e509a3
I20260807 20:21:34.404783 30953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a: No bootstrap required, opened a new log
I20260807 20:21:34.406605 30953 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b1abff9307445c2adad31a162f1cd5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37187 } }
I20260807 20:21:34.406750 30953 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:34.406787 30953 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b1abff9307445c2adad31a162f1cd5a, State: Initialized, Role: FOLLOWER
I20260807 20:21:34.406910 30953 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b1abff9307445c2adad31a162f1cd5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37187 } }
I20260807 20:21:34.406984 30953 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:34.407024 30953 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:34.407069 30953 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:34.407586 30953 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b1abff9307445c2adad31a162f1cd5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37187 } }
I20260807 20:21:34.407684 30953 leader_election.cc:302] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b1abff9307445c2adad31a162f1cd5a; no voters:
I20260807 20:21:34.407878 30953 leader_election.cc:288] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:34.407922 30961 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:34.408066 30961 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [term 1 LEADER]: Becoming Leader. State: Replica: 8b1abff9307445c2adad31a162f1cd5a, State: Running, Role: LEADER
I20260807 20:21:34.408142 30953 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:34.408150 30961 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b1abff9307445c2adad31a162f1cd5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37187 } }
I20260807 20:21:34.408529 30961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b1abff9307445c2adad31a162f1cd5a. Latest consensus state: current_term: 1 leader_uuid: "8b1abff9307445c2adad31a162f1cd5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b1abff9307445c2adad31a162f1cd5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37187 } } }
I20260807 20:21:34.408612 30961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:34.408764 30964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b1abff9307445c2adad31a162f1cd5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b1abff9307445c2adad31a162f1cd5a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37187 } } }
I20260807 20:21:34.408820 30964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:34.408917 30973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:34.409422 30973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 20:21:34 dist-test-slave-t7g5 krb5kdc[30826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134094, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 20:21:34.415241 30973 catalog_manager.cc:1347] Generated new cluster ID: 42a1b009eae443aeae0d56aa090074bf
I20260807 20:21:34.415299 30973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:34.415794 30960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:34.404820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:60243 (local address 127.0.0.1:37187)
0807 20:21:34.405001 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:34.405011 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:34.405038 (+ 27us) server_negotiation.cc:407] Connection header received
0807 20:21:34.405967 (+ 929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:34.405974 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:34.406029 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:34.406157 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:34.406786 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:34.408186 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:34.409252 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:34.409848 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:34.409972 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:34.412481 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:34.412485 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:34.412486 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:34.412497 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:34.414135 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:34.414537 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:34.414540 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:34.414541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:34.414628 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:34.414900 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:34.414901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:34.414902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:34.415198 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:34.415369 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:34.415503 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 20:21:34.415604 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":86,"threads_started":1}
I20260807 20:21:34.416725 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:34.422983 30973 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:34.423652 30973 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:34.427703 30960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:34.422032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:52605 (local address 127.0.0.1:37187)
0807 20:21:34.422072 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:34.422074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:34.422152 (+ 78us) server_negotiation.cc:407] Connection header received
0807 20:21:34.422206 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:34.422206 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:34.422216 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:34.422260 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:34.422790 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:34.423375 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:34.424080 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:34.424296 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:34.424350 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:34.425405 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:34.425406 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:34.425406 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:34.425413 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:34.426651 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:34.426990 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:34.426991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:34.426991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:34.427046 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:34.427231 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:34.427231 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:34.427232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:34.427335 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:34.427424 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:34.427560 (+ 136us) server_negotiation.cc:299] Negotiation successful
0807 20:21:34.427620 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 20:21:34.429232 30973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b1abff9307445c2adad31a162f1cd5a: Generated new TSK 0
I20260807 20:21:34.429394 30973 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:34.435034 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 30846
W20260807 20:21:34.456193 30823 connection.cc:535] client connection to 127.0.0.1:37187 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37187): Connection reset by peer (error 104)
2026-08-07T20:21:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1431 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:34 dist-test-slave-t7g5 krb5kdc[31011](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:34 dist-test-slave-t7g5 krb5kdc[31011](info): set up 2 sockets
Aug 07 20:21:34 dist-test-slave-t7g5 krb5kdc[31011](info): commencing operation
krb5kdc: starting...
W20260807 20:21:35.593222 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.123s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:35 dist-test-slave-t7g5 krb5kdc[31011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:21:35.710204 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36571
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:35.794075 31032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:35.794288 31032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:35.794318 31032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:35.795480 31032 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:35.795522 31032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:35.795542 31032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:35.795557 31032 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:35.795572 31032 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:35.797079 31032 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:35.797340 31032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:35.797545 31032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:35.802218 31039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:35.802284 31040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:35.802448 31032 server_base.cc:1034] running on GCE node
W20260807 20:21:35.802223 31042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:35.802755 31032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:35.803037 31032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:35.804184 31032 hybrid_clock.cc:648] HybridClock initialized: now 1786134095804167 us; error 35 us; skew 500 ppm
Aug 07 20:21:35 dist-test-slave-t7g5 krb5kdc[31011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134095, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:35.806614 31032 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:21:35.807053 31032 webserver.cc:460] Webserver started at http://127.0.0.1:35393/ using document root <none> and password file <none>
I20260807 20:21:35.807240 31032 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:35.807277 31032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:35.807372 31032 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:35.808357 31032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "6b0370a78eff4275aa6c70d6a071a727"
format_stamp: "Formatted at 2026-08-07 20:21:35 on dist-test-slave-t7g5"
server_key: "15d373cb66c211a94f006e1eecc9f3c6"
server_key_iv: "a5bc15ed92d93a9bb7e98f607269a138"
server_key_version: "encryptionkey@0"
I20260807 20:21:35.808642 31032 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "6b0370a78eff4275aa6c70d6a071a727"
format_stamp: "Formatted at 2026-08-07 20:21:35 on dist-test-slave-t7g5"
server_key: "15d373cb66c211a94f006e1eecc9f3c6"
server_key_iv: "a5bc15ed92d93a9bb7e98f607269a138"
server_key_version: "encryptionkey@0"
I20260807 20:21:35.809859 31032 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:21:35.810511 31051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:35.810679 31032 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:35.810765 31032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "6b0370a78eff4275aa6c70d6a071a727"
format_stamp: "Formatted at 2026-08-07 20:21:35 on dist-test-slave-t7g5"
server_key: "15d373cb66c211a94f006e1eecc9f3c6"
server_key_iv: "a5bc15ed92d93a9bb7e98f607269a138"
server_key_version: "encryptionkey@0"
I20260807 20:21:35.810822 31032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:35.822671 31032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:35.824759 31032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:35.824872 31032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:35.828810 31032 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36571
I20260807 20:21:35.828855 31132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36571 every 8 connection(s)
I20260807 20:21:35.829337 31032 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:35.830075 31133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:35.830075 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 31032
I20260807 20:21:35.830178 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:35.830375 30863 external_mini_cluster.cc:1428] Setting key 3ff959e14ce83b83652a4434c6e3d9ec
I20260807 20:21:35.833166 31133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727: Bootstrap starting.
I20260807 20:21:35.833900 31133 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:35.834183 31133 log.cc:824] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:35.834883 31133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727: No bootstrap required, opened a new log
I20260807 20:21:35.835901 31138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:35.831030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:45975 (local address 127.0.0.1:36571)
0807 20:21:35.831202 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:35.831211 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:35.831236 (+ 25us) server_negotiation.cc:407] Connection header received
0807 20:21:35.831677 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:35.831684 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:35.831734 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:35.831844 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:35.832081 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:35.832951 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:35.834017 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:35.834448 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:35.834541 (+ 93us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:35.835220 (+ 679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:35.835224 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:35.835225 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:35.835388 (+ 163us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:35.835419 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:35.835430 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:35.835509 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:35.835631 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 20:21:35.835657 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":80,"threads_started":1}
I20260807 20:21:35.836921 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:35.837103 31133 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b0370a78eff4275aa6c70d6a071a727" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36571 } }
I20260807 20:21:35.837244 31133 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:35.837276 31133 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0370a78eff4275aa6c70d6a071a727, State: Initialized, Role: FOLLOWER
I20260807 20:21:35.837393 31133 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b0370a78eff4275aa6c70d6a071a727" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36571 } }
I20260807 20:21:35.837486 31133 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:35.837520 31133 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:35.837570 31133 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:35.838191 31133 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b0370a78eff4275aa6c70d6a071a727" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36571 } }
I20260807 20:21:35.838308 31133 leader_election.cc:302] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6b0370a78eff4275aa6c70d6a071a727; no voters:
I20260807 20:21:35.838483 31133 leader_election.cc:288] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:35.838517 31153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:35.838753 31133 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:35.838752 31153 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [term 1 LEADER]: Becoming Leader. State: Replica: 6b0370a78eff4275aa6c70d6a071a727, State: Running, Role: LEADER
I20260807 20:21:35.838964 31153 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b0370a78eff4275aa6c70d6a071a727" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36571 } }
I20260807 20:21:35.839363 31157 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6b0370a78eff4275aa6c70d6a071a727. Latest consensus state: current_term: 1 leader_uuid: "6b0370a78eff4275aa6c70d6a071a727" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b0370a78eff4275aa6c70d6a071a727" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36571 } } }
I20260807 20:21:35.839442 31157 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:35.839841 31156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6b0370a78eff4275aa6c70d6a071a727" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6b0370a78eff4275aa6c70d6a071a727" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36571 } } }
I20260807 20:21:35.839905 31156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727 [sys.catalog]: This master's current role is: LEADER
W20260807 20:21:35.840695 31177 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:21:35.840752 31177 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:21:35.840916 31167 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:35.841135 31167 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:35.841630 31138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:35.838309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:35019 (local address 127.0.0.1:36571)
0807 20:21:35.838352 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:35.838354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:35.838380 (+ 26us) server_negotiation.cc:407] Connection header received
0807 20:21:35.838453 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:35.838454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:35.838464 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:35.838511 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:35.838667 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:35.839347 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:35.840301 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:35.840575 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:35.840650 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:35.841387 (+ 737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:35.841388 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:35.841388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:35.841393 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:35.841409 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:35.841414 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:35.841480 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:35.841552 (+ 72us) server_negotiation.cc:299] Negotiation successful
0807 20:21:35.841562 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260807 20:21:35.842599 31167 catalog_manager.cc:1347] Generated new cluster ID: ac5c1a11bb4d4db9948bc8d1a23e9d56
I20260807 20:21:35.842653 31167 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:35.867463 31167 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:35.867991 31167 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:35.876622 31167 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6b0370a78eff4275aa6c70d6a071a727: Generated new TSK 0
I20260807 20:21:35.876799 31167 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:35.884361 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 31032
W20260807 20:21:35.891515 31008 connection.cc:535] client connection to 127.0.0.1:36571 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36571): Connection reset by peer (error 104)
2026-08-07T20:21:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1435 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:35 dist-test-slave-t7g5 krb5kdc[31186](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:35 dist-test-slave-t7g5 krb5kdc[31186](info): set up 2 sockets
Aug 07 20:21:35 dist-test-slave-t7g5 krb5kdc[31186](info): commencing operation
krb5kdc: starting...
W20260807 20:21:37.027352 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:37 dist-test-slave-t7g5 krb5kdc[31186](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:21:37.146659 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42817
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42817
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:37.227676 31204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:37.227891 31204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:37.227912 31204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:37.229018 31204 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:37.229053 31204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:37.229066 31204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:37.229077 31204 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:37.229087 31204 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:37.230561 31204 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42817
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:37.230769 31204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:37.230947 31204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:37.235491 31214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:37.235498 31211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:37.235502 31218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:37.235759 31204 server_base.cc:1034] running on GCE node
I20260807 20:21:37.236040 31204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:37.236313 31204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:37.237457 31204 hybrid_clock.cc:648] HybridClock initialized: now 1786134097237441 us; error 26 us; skew 500 ppm
Aug 07 20:21:37 dist-test-slave-t7g5 krb5kdc[31186](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134097, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:37.239789 31204 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:21:37.240177 31204 webserver.cc:460] Webserver started at http://127.0.0.1:42799/ using document root <none> and password file <none>
I20260807 20:21:37.240374 31204 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:37.240429 31204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:37.240556 31204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:37.241591 31204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "9914ce823b904cef9c4042b8fbf3dfa6"
format_stamp: "Formatted at 2026-08-07 20:21:37 on dist-test-slave-t7g5"
server_key: "4a96ad188ec15932e28139aeac0ed57b"
server_key_iv: "c7660cd786dd7893feeb9c105d01fa9f"
server_key_version: "encryptionkey@0"
I20260807 20:21:37.241956 31204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "9914ce823b904cef9c4042b8fbf3dfa6"
format_stamp: "Formatted at 2026-08-07 20:21:37 on dist-test-slave-t7g5"
server_key: "4a96ad188ec15932e28139aeac0ed57b"
server_key_iv: "c7660cd786dd7893feeb9c105d01fa9f"
server_key_version: "encryptionkey@0"
I20260807 20:21:37.243148 31204 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:21:37.243804 31226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:37.243953 31204 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:37.244035 31204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "9914ce823b904cef9c4042b8fbf3dfa6"
format_stamp: "Formatted at 2026-08-07 20:21:37 on dist-test-slave-t7g5"
server_key: "4a96ad188ec15932e28139aeac0ed57b"
server_key_iv: "c7660cd786dd7893feeb9c105d01fa9f"
server_key_version: "encryptionkey@0"
I20260807 20:21:37.244097 31204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:37.247254 31204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:37.249017 31204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:37.249141 31204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:37.252831 31204 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42817
I20260807 20:21:37.252875 31301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42817 every 8 connection(s)
I20260807 20:21:37.253145 31204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:37.254110 31302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:37.256206 31302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6: Bootstrap starting.
I20260807 20:21:37.256736 31302 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:37.256989 31302 log.cc:824] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:37.257603 31302 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6: No bootstrap required, opened a new log
I20260807 20:21:37.259135 31302 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9914ce823b904cef9c4042b8fbf3dfa6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } }
I20260807 20:21:37.259265 31302 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:37.259294 31302 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9914ce823b904cef9c4042b8fbf3dfa6, State: Initialized, Role: FOLLOWER
I20260807 20:21:37.259403 31302 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9914ce823b904cef9c4042b8fbf3dfa6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } }
I20260807 20:21:37.259477 31302 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:37.259505 31302 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:37.259536 31302 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:37.259994 31302 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9914ce823b904cef9c4042b8fbf3dfa6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } }
I20260807 20:21:37.260079 31302 leader_election.cc:302] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9914ce823b904cef9c4042b8fbf3dfa6; no voters:
I20260807 20:21:37.260200 31302 leader_election.cc:288] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:37.260250 31305 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:37.260403 31305 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [term 1 LEADER]: Becoming Leader. State: Replica: 9914ce823b904cef9c4042b8fbf3dfa6, State: Running, Role: LEADER
I20260807 20:21:37.260416 31302 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:37.260504 31305 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9914ce823b904cef9c4042b8fbf3dfa6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } }
I20260807 20:21:37.260852 31308 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9914ce823b904cef9c4042b8fbf3dfa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9914ce823b904cef9c4042b8fbf3dfa6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } } }
I20260807 20:21:37.260857 31310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9914ce823b904cef9c4042b8fbf3dfa6. Latest consensus state: current_term: 1 leader_uuid: "9914ce823b904cef9c4042b8fbf3dfa6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9914ce823b904cef9c4042b8fbf3dfa6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } } }
I20260807 20:21:37.260977 31308 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:37.260998 31310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:37.261469 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 31204
I20260807 20:21:37.261587 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:37.261816 30863 external_mini_cluster.cc:1428] Setting key 60bc8732a4eb7318c8ab13848624ff51
I20260807 20:21:37.262012 31315 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:37.262526 31315 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:37.264057 31315 catalog_manager.cc:1347] Generated new cluster ID: f3e3b140c6884443b9fd93239d2e22b3
I20260807 20:21:37.264122 31315 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:37.264276 31336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:37.262468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:53785 (local address 127.0.0.1:42817)
0807 20:21:37.262649 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:37.262659 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:37.262694 (+ 35us) server_negotiation.cc:407] Connection header received
0807 20:21:37.262815 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:37.262822 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:37.262880 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:37.263022 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:37.263696 (+ 674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:37.263700 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:37.263700 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:37.263705 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:37.263747 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:37.263760 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:37.263788 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:37.263896 (+ 108us) server_negotiation.cc:299] Negotiation successful
0807 20:21:37.264048 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":65,"threads_started":1}
I20260807 20:21:37.266059 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:37.274863 31315 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:37.275023 31315 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:37.277967 31336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:37.273894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:37729 (local address 127.0.0.1:42817)
0807 20:21:37.273929 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:37.273930 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:37.274051 (+ 121us) server_negotiation.cc:407] Connection header received
0807 20:21:37.274110 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:37.274111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:37.274116 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:37.274160 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:37.277749 (+ 3589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:37.277750 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:37.277750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:37.277756 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:37.277773 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:37.277777 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:37.277825 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:37.277880 (+ 55us) server_negotiation.cc:299] Negotiation successful
0807 20:21:37.277893 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 20:21:37.281145 31315 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9914ce823b904cef9c4042b8fbf3dfa6: Generated new TSK 0
I20260807 20:21:37.281327 31315 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:37.283794 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 31204
2026-08-07T20:21:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1403 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:37 dist-test-slave-t7g5 krb5kdc[31353](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:37 dist-test-slave-t7g5 krb5kdc[31353](info): set up 2 sockets
Aug 07 20:21:37 dist-test-slave-t7g5 krb5kdc[31353](info): commencing operation
krb5kdc: starting...
W20260807 20:21:38.426151 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:38 dist-test-slave-t7g5 krb5kdc[31353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:21:38.542479 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42731
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:38.623188 31376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:38.623426 31376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:38.623459 31376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:38.624591 31376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:38.624632 31376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:38.624651 31376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:38.624667 31376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:38.624682 31376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:38.626169 31376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42731
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:38.626425 31376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:38.626636 31376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:38.631349 31384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:38.631345 31386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:38.631350 31389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:38.631572 31376 server_base.cc:1034] running on GCE node
I20260807 20:21:38.631868 31376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:38.632125 31376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:38.633263 31376 hybrid_clock.cc:648] HybridClock initialized: now 1786134098633243 us; error 36 us; skew 500 ppm
Aug 07 20:21:38 dist-test-slave-t7g5 krb5kdc[31353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134098, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:38.635627 31376 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:21:38.636067 31376 webserver.cc:460] Webserver started at http://127.0.0.1:46603/ using document root <none> and password file <none>
I20260807 20:21:38.636264 31376 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:38.636313 31376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:38.636448 31376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:38.637463 31376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "a3d0939bdd004d389c2667e9a95e959d"
format_stamp: "Formatted at 2026-08-07 20:21:38 on dist-test-slave-t7g5"
server_key: "6bd451134cb80b995d4c2f416ca2b788"
server_key_iv: "05204cf2228d8bf852d6a9542f3f50a3"
server_key_version: "encryptionkey@0"
I20260807 20:21:38.637825 31376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "a3d0939bdd004d389c2667e9a95e959d"
format_stamp: "Formatted at 2026-08-07 20:21:38 on dist-test-slave-t7g5"
server_key: "6bd451134cb80b995d4c2f416ca2b788"
server_key_iv: "05204cf2228d8bf852d6a9542f3f50a3"
server_key_version: "encryptionkey@0"
I20260807 20:21:38.639042 31376 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:21:38.639689 31399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:38.639839 31376 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:21:38.639926 31376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "a3d0939bdd004d389c2667e9a95e959d"
format_stamp: "Formatted at 2026-08-07 20:21:38 on dist-test-slave-t7g5"
server_key: "6bd451134cb80b995d4c2f416ca2b788"
server_key_iv: "05204cf2228d8bf852d6a9542f3f50a3"
server_key_version: "encryptionkey@0"
I20260807 20:21:38.639987 31376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:38.655480 31376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:38.657433 31376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:38.657590 31376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:38.661463 31376 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42731
I20260807 20:21:38.661504 31467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42731 every 8 connection(s)
I20260807 20:21:38.661875 31376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:38.662710 31476 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:38.664974 31476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d: Bootstrap starting.
I20260807 20:21:38.665501 31476 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:38.665755 31476 log.cc:824] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:38.666385 31476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d: No bootstrap required, opened a new log
I20260807 20:21:38.667058 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 31376
I20260807 20:21:38.667189 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:38.667382 30863 external_mini_cluster.cc:1428] Setting key 41fe7b39669221b37766056b46889da2
I20260807 20:21:38.668411 31476 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d0939bdd004d389c2667e9a95e959d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42731 } }
I20260807 20:21:38.668571 31476 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:38.668612 31476 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3d0939bdd004d389c2667e9a95e959d, State: Initialized, Role: FOLLOWER
I20260807 20:21:38.668743 31476 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d0939bdd004d389c2667e9a95e959d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42731 } }
I20260807 20:21:38.668825 31476 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:38.668864 31476 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:38.668911 31476 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:38.669920 31476 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d0939bdd004d389c2667e9a95e959d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42731 } }
I20260807 20:21:38.670037 31476 leader_election.cc:302] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3d0939bdd004d389c2667e9a95e959d; no voters:
I20260807 20:21:38.670183 31476 leader_election.cc:288] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:38.670228 31485 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:38.670368 31485 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [term 1 LEADER]: Becoming Leader. State: Replica: a3d0939bdd004d389c2667e9a95e959d, State: Running, Role: LEADER
I20260807 20:21:38.670429 31476 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:38.670481 31485 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d0939bdd004d389c2667e9a95e959d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42731 } }
I20260807 20:21:38.670856 31485 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3d0939bdd004d389c2667e9a95e959d. Latest consensus state: current_term: 1 leader_uuid: "a3d0939bdd004d389c2667e9a95e959d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d0939bdd004d389c2667e9a95e959d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42731 } } }
I20260807 20:21:38.670908 31487 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3d0939bdd004d389c2667e9a95e959d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d0939bdd004d389c2667e9a95e959d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42731 } } }
I20260807 20:21:38.670979 31487 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:38.670930 31485 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:38.671219 31501 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:38.671792 31501 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 20:21:38 dist-test-slave-t7g5 krb5kdc[31353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 20:21:38.674610 31501 catalog_manager.cc:1347] Generated new cluster ID: 9bc530da1a934e66a92c3cb3356c0d8d
I20260807 20:21:38.674660 31501 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:38.678802 31481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:38.667904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:56015 (local address 127.0.0.1:42731)
0807 20:21:38.668080 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:38.668088 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:38.668114 (+ 26us) server_negotiation.cc:407] Connection header received
0807 20:21:38.668376 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:38.668382 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:38.668430 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:38.668540 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:38.669317 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:38.670387 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:38.671443 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:38.672025 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:38.672127 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:38.675068 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:38.675073 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:38.675074 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:38.675086 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:38.677085 (+ 1999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:38.677509 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:38.677513 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:38.677513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:38.677678 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:38.677891 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:38.677892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:38.677892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:38.678213 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:38.678385 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:38.678481 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 20:21:38.678591 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":69,"threads_started":1}
I20260807 20:21:38.680047 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:38.690480 31481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:38.681521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:58321 (local address 127.0.0.1:42731)
0807 20:21:38.681555 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:38.681557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:38.681613 (+ 56us) server_negotiation.cc:407] Connection header received
0807 20:21:38.681693 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:38.681694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:38.681704 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:38.681743 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:38.684277 (+ 2534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:38.685073 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:38.686034 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:38.686380 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:38.686462 (+ 82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:38.687683 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:38.687684 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:38.687685 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:38.687692 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:38.689184 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:38.689619 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:38.689620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:38.689621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:38.689703 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:38.689986 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:38.689986 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:38.689987 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:38.690102 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:38.690192 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:38.690326 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 20:21:38.690389 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 20:21:38.708230 31501 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:38.708802 31501 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:38.712798 31501 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3d0939bdd004d389c2667e9a95e959d: Generated new TSK 0
I20260807 20:21:38.712990 31501 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:38.716477 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 31376
W20260807 20:21:38.730887 31347 connection.cc:535] client connection to 127.0.0.1:42731 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42731): Connection reset by peer (error 104)
2026-08-07T20:21:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1435 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:38 dist-test-slave-t7g5 krb5kdc[31523](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:38 dist-test-slave-t7g5 krb5kdc[31523](info): set up 2 sockets
Aug 07 20:21:38 dist-test-slave-t7g5 krb5kdc[31523](info): commencing operation
krb5kdc: starting...
W20260807 20:21:39.863406 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:39 dist-test-slave-t7g5 krb5kdc[31523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134099, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:21:39.982235 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39263
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39263
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:40.063510 31549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:40.063740 31549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:40.063763 31549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:40.064884 31549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:40.064922 31549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:40.064935 31549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:40.064945 31549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:40.064961 31549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:40.066447 31549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39263
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31549
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:40.066685 31549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:40.066917 31549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:40.071697 31560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:40.071703 31555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:40.071704 31556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:40.072019 31549 server_base.cc:1034] running on GCE node
I20260807 20:21:40.072266 31549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:40.072542 31549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:40.073695 31549 hybrid_clock.cc:648] HybridClock initialized: now 1786134100073686 us; error 31 us; skew 500 ppm
Aug 07 20:21:40 dist-test-slave-t7g5 krb5kdc[31523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134100, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:40.080289 31549 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:21:40.080768 31549 webserver.cc:460] Webserver started at http://127.0.0.1:39129/ using document root <none> and password file <none>
I20260807 20:21:40.080984 31549 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:40.081029 31549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:40.081154 31549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:40.082255 31549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "083cdd9d7af8418091213c90cdb65bcc"
format_stamp: "Formatted at 2026-08-07 20:21:40 on dist-test-slave-t7g5"
server_key: "354a55654d7e4e1501108060901aa909"
server_key_iv: "e596e8a53f761b513e700d99593a0dbc"
server_key_version: "encryptionkey@0"
I20260807 20:21:40.082595 31549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "083cdd9d7af8418091213c90cdb65bcc"
format_stamp: "Formatted at 2026-08-07 20:21:40 on dist-test-slave-t7g5"
server_key: "354a55654d7e4e1501108060901aa909"
server_key_iv: "e596e8a53f761b513e700d99593a0dbc"
server_key_version: "encryptionkey@0"
I20260807 20:21:40.083854 31549 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:21:40.084537 31570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:40.084702 31549 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:40.084790 31549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "083cdd9d7af8418091213c90cdb65bcc"
format_stamp: "Formatted at 2026-08-07 20:21:40 on dist-test-slave-t7g5"
server_key: "354a55654d7e4e1501108060901aa909"
server_key_iv: "e596e8a53f761b513e700d99593a0dbc"
server_key_version: "encryptionkey@0"
I20260807 20:21:40.084852 31549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:40.095813 31549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:40.097739 31549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:40.097879 31549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:40.102041 31549 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39263
I20260807 20:21:40.102070 31656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39263 every 8 connection(s)
I20260807 20:21:40.102411 31549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:40.103263 31657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:40.105528 31657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc: Bootstrap starting.
I20260807 20:21:40.106107 31657 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:40.106370 31657 log.cc:824] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:40.107048 31657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc: No bootstrap required, opened a new log
I20260807 20:21:40.107197 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 31549
I20260807 20:21:40.107321 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:40.107520 30863 external_mini_cluster.cc:1428] Setting key 1f607f4f6754643f2b3aaa4aba308323
I20260807 20:21:40.108961 31657 raft_consensus.cc:348] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "083cdd9d7af8418091213c90cdb65bcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39263 } }
I20260807 20:21:40.109117 31657 raft_consensus.cc:374] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:40.109153 31657 raft_consensus.cc:729] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 083cdd9d7af8418091213c90cdb65bcc, State: Initialized, Role: FOLLOWER
I20260807 20:21:40.109316 31657 consensus_queue.cc:260] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "083cdd9d7af8418091213c90cdb65bcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39263 } }
I20260807 20:21:40.109400 31657 raft_consensus.cc:388] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:40.109423 31657 raft_consensus.cc:482] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:40.109465 31657 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:40.110059 31657 raft_consensus.cc:504] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "083cdd9d7af8418091213c90cdb65bcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39263 } }
I20260807 20:21:40.110145 31657 leader_election.cc:302] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 083cdd9d7af8418091213c90cdb65bcc; no voters:
I20260807 20:21:40.110292 31657 leader_election.cc:288] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:40.110340 31662 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:40.110487 31662 raft_consensus.cc:686] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [term 1 LEADER]: Becoming Leader. State: Replica: 083cdd9d7af8418091213c90cdb65bcc, State: Running, Role: LEADER
I20260807 20:21:40.110548 31657 sys_catalog.cc:564] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:40.110622 31662 consensus_queue.cc:237] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "083cdd9d7af8418091213c90cdb65bcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39263 } }
I20260807 20:21:40.111049 31664 sys_catalog.cc:455] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "083cdd9d7af8418091213c90cdb65bcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "083cdd9d7af8418091213c90cdb65bcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39263 } } }
I20260807 20:21:40.111052 31665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 083cdd9d7af8418091213c90cdb65bcc. Latest consensus state: current_term: 1 leader_uuid: "083cdd9d7af8418091213c90cdb65bcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "083cdd9d7af8418091213c90cdb65bcc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39263 } } }
I20260807 20:21:40.111227 31664 sys_catalog.cc:458] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:40.111233 31665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:40.111512 31674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:40.112241 31674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:40.113893 31674 catalog_manager.cc:1347] Generated new cluster ID: 5d15dc728f3d4ceda1826b39778f2483
I20260807 20:21:40.113945 31674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:40.114219 31661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:40.108010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:54045 (local address 127.0.0.1:39263)
0807 20:21:40.108183 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:40.108191 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:40.108217 (+ 26us) server_negotiation.cc:407] Connection header received
0807 20:21:40.108927 (+ 710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:40.108933 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:40.108985 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:40.109096 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:40.109335 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:40.110775 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:40.111916 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:40.112548 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:40.112649 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:40.113547 (+ 898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:40.113551 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:40.113551 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:40.113762 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:40.113837 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:40.113854 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:40.113935 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:40.114015 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 20:21:40.114043 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
I20260807 20:21:40.115072 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:40.121160 31661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:40.118184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:34251 (local address 127.0.0.1:39263)
0807 20:21:40.118224 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:40.118226 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:40.118416 (+ 190us) server_negotiation.cc:407] Connection header received
0807 20:21:40.118474 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:40.118475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:40.118486 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:40.118532 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:40.118653 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:40.119323 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:40.120017 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:40.120240 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:40.120295 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:40.120917 (+ 622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:40.120919 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:40.120919 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:40.120923 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:40.120938 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:40.120943 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:40.120988 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:40.121064 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 20:21:40.121076 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 20:21:40.129106 31674 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:40.129647 31674 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:40.135440 31674 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 083cdd9d7af8418091213c90cdb65bcc: Generated new TSK 0
I20260807 20:21:40.135641 31674 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:40.140218 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 31549
W20260807 20:21:40.152501 31521 connection.cc:535] client connection to 127.0.0.1:39263 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39263): Connection reset by peer (error 104)
2026-08-07T20:21:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1421 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:40 dist-test-slave-t7g5 krb5kdc[31701](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:40 dist-test-slave-t7g5 krb5kdc[31701](info): set up 2 sockets
Aug 07 20:21:40 dist-test-slave-t7g5 krb5kdc[31701](info): commencing operation
krb5kdc: starting...
W20260807 20:21:41.288321 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:41 dist-test-slave-t7g5 krb5kdc[31701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134101, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 20:21:41.402627 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39553
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33499
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:41.485613 31720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:41.485858 31720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:41.485896 31720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:41.487066 31720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:41.487108 31720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:41.487126 31720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:41.487141 31720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:41.487157 31720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:41.488605 31720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33499
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39553
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:41.488853 31720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:41.489058 31720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:41.493634 31730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:41.493671 31726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:41.493741 31720 server_base.cc:1034] running on GCE node
W20260807 20:21:41.493875 31727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:41.494109 31720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:41.494345 31720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:41.495497 31720 hybrid_clock.cc:648] HybridClock initialized: now 1786134101495487 us; error 28 us; skew 500 ppm
Aug 07 20:21:41 dist-test-slave-t7g5 krb5kdc[31701](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134101, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:41.497828 31720 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 20:21:41.498225 31720 webserver.cc:460] Webserver started at http://127.0.0.1:37569/ using document root <none> and password file <none>
I20260807 20:21:41.498440 31720 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:41.498492 31720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:41.498613 31720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:41.499612 31720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "837d518dad664c40a5d5f5aa3cfe1771"
format_stamp: "Formatted at 2026-08-07 20:21:41 on dist-test-slave-t7g5"
server_key: "58afd47f5d3cbf8c32fbdc427e3b6897"
server_key_iv: "4cc8dbc31a71f9ce22aa0031884d45ac"
server_key_version: "encryptionkey@0"
I20260807 20:21:41.499944 31720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "837d518dad664c40a5d5f5aa3cfe1771"
format_stamp: "Formatted at 2026-08-07 20:21:41 on dist-test-slave-t7g5"
server_key: "58afd47f5d3cbf8c32fbdc427e3b6897"
server_key_iv: "4cc8dbc31a71f9ce22aa0031884d45ac"
server_key_version: "encryptionkey@0"
I20260807 20:21:41.501188 31720 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:21:41.501926 31740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:41.502085 31720 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:41.502170 31720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "837d518dad664c40a5d5f5aa3cfe1771"
format_stamp: "Formatted at 2026-08-07 20:21:41 on dist-test-slave-t7g5"
server_key: "58afd47f5d3cbf8c32fbdc427e3b6897"
server_key_iv: "4cc8dbc31a71f9ce22aa0031884d45ac"
server_key_version: "encryptionkey@0"
I20260807 20:21:41.502241 31720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:41.505620 31720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:41.507457 31720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:41.507580 31720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:41.511423 31720 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39553
I20260807 20:21:41.511468 31818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39553 every 8 connection(s)
I20260807 20:21:41.511775 31720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:41.512755 31819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:41.515209 31819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771: Bootstrap starting.
I20260807 20:21:41.515858 31819 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:41.516137 31819 log.cc:824] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:41.516923 31819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771: No bootstrap required, opened a new log
I20260807 20:21:41.517088 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 31720
I20260807 20:21:41.517203 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:41.517387 30863 external_mini_cluster.cc:1428] Setting key 7285fe55771695a618d1f668541142bd
I20260807 20:21:41.518958 31819 raft_consensus.cc:348] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "837d518dad664c40a5d5f5aa3cfe1771" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39553 } }
I20260807 20:21:41.519131 31819 raft_consensus.cc:374] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:41.519176 31819 raft_consensus.cc:729] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837d518dad664c40a5d5f5aa3cfe1771, State: Initialized, Role: FOLLOWER
I20260807 20:21:41.519310 31819 consensus_queue.cc:260] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "837d518dad664c40a5d5f5aa3cfe1771" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39553 } }
I20260807 20:21:41.519428 31819 raft_consensus.cc:388] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:41.519491 31819 raft_consensus.cc:482] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:41.519547 31819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:41.520043 31825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:41.517880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:60891 (local address 127.0.0.1:39553)
0807 20:21:41.518082 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:41.518092 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:41.518120 (+ 28us) server_negotiation.cc:407] Connection header received
0807 20:21:41.518622 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:41.518630 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:41.518666 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:41.518795 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:41.519523 (+ 728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:41.519527 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:41.519527 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:41.519531 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:41.519583 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:41.519599 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:41.519657 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:41.519813 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 20:21:41.519864 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":87,"threads_started":1}
I20260807 20:21:41.520543 31819 raft_consensus.cc:504] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "837d518dad664c40a5d5f5aa3cfe1771" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39553 } }
I20260807 20:21:41.520661 31819 leader_election.cc:302] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 837d518dad664c40a5d5f5aa3cfe1771; no voters:
I20260807 20:21:41.520843 31819 leader_election.cc:288] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:41.520864 31826 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:41.520975 31826 raft_consensus.cc:686] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [term 1 LEADER]: Becoming Leader. State: Replica: 837d518dad664c40a5d5f5aa3cfe1771, State: Running, Role: LEADER
I20260807 20:21:41.521030 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:41.521061 31826 consensus_queue.cc:237] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "837d518dad664c40a5d5f5aa3cfe1771" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39553 } }
I20260807 20:21:41.521116 31819 sys_catalog.cc:564] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:41.521370 31826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 837d518dad664c40a5d5f5aa3cfe1771. Latest consensus state: current_term: 1 leader_uuid: "837d518dad664c40a5d5f5aa3cfe1771" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "837d518dad664c40a5d5f5aa3cfe1771" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39553 } } }
I20260807 20:21:41.521445 31826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:41.521571 31826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "837d518dad664c40a5d5f5aa3cfe1771" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "837d518dad664c40a5d5f5aa3cfe1771" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39553 } } }
I20260807 20:21:41.521618 31826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:41.521867 31834 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:41.522373 31834 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:41.523895 31825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:41.522801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.70:37087 (local address 127.0.0.1:39553)
0807 20:21:41.522873 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:41.522875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:41.523015 (+ 140us) server_negotiation.cc:407] Connection header received
0807 20:21:41.523040 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:41.523041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:41.523046 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:41.523113 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:41.523670 (+ 557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:41.523671 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:41.523671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:41.523675 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:41.523690 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:41.523695 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:41.523754 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:41.523812 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 20:21:41.523825 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 20:21:41.524586 31834 catalog_manager.cc:1347] Generated new cluster ID: 7019abca80c24741abed3f663d52ebe9
I20260807 20:21:41.524639 31834 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:41.536530 31834 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:41.536751 31834 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:41.540982 31834 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 837d518dad664c40a5d5f5aa3cfe1771: Generated new TSK 0
I20260807 20:21:41.541183 31834 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:41.542618 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 31720
2026-08-07T20:21:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1409 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:41 dist-test-slave-t7g5 krb5kdc[31878](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:41 dist-test-slave-t7g5 krb5kdc[31878](info): set up 2 sockets
Aug 07 20:21:41 dist-test-slave-t7g5 krb5kdc[31878](info): commencing operation
krb5kdc: starting...
W20260807 20:21:42.705295 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:42 dist-test-slave-t7g5 krb5kdc[31878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:21:42.823887 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:44967
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:44303
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:44967
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:42.904515 31893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:42.904731 31893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:42.904752 31893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:42.906000 31893 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:42.906057 31893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:42.906071 31893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:42.906095 31893 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:42.906111 31893 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:42.907641 31893 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:44303
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:44967
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:44967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:42.907889 31893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:42.908102 31893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:42.912853 31902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:42.912839 31907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:42.912865 31903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:42.913035 31893 server_base.cc:1034] running on GCE node
I20260807 20:21:42.913292 31893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:42.913609 31893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:42.914829 31893 hybrid_clock.cc:648] HybridClock initialized: now 1786134102914813 us; error 29 us; skew 500 ppm
Aug 07 20:21:42 dist-test-slave-t7g5 krb5kdc[31878](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134102, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:42.917376 31893 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:21:42.917933 31893 webserver.cc:460] Webserver started at http://127.30.35.254:33805/ using document root <none> and password file <none>
I20260807 20:21:42.918164 31893 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:42.918218 31893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:42.918350 31893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:42.919476 31893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "95d67383616148439001af3aee767c76"
format_stamp: "Formatted at 2026-08-07 20:21:42 on dist-test-slave-t7g5"
server_key: "3c6ef632a883055dffad67672702a75e"
server_key_iv: "b81368048a9db4719fa01ee2058ee47a"
server_key_version: "encryptionkey@0"
I20260807 20:21:42.919836 31893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "95d67383616148439001af3aee767c76"
format_stamp: "Formatted at 2026-08-07 20:21:42 on dist-test-slave-t7g5"
server_key: "3c6ef632a883055dffad67672702a75e"
server_key_iv: "b81368048a9db4719fa01ee2058ee47a"
server_key_version: "encryptionkey@0"
I20260807 20:21:42.921197 31893 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:21:42.922055 31916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:42.922274 31893 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:21:42.922366 31893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "95d67383616148439001af3aee767c76"
format_stamp: "Formatted at 2026-08-07 20:21:42 on dist-test-slave-t7g5"
server_key: "3c6ef632a883055dffad67672702a75e"
server_key_iv: "b81368048a9db4719fa01ee2058ee47a"
server_key_version: "encryptionkey@0"
I20260807 20:21:42.922435 31893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:42.940469 31893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:42.942480 31893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:42.942621 31893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:42.946470 31893 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:44967
I20260807 20:21:42.946519 32000 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:44967 every 8 connection(s)
I20260807 20:21:42.946869 31893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:42.947718 32001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:42.948735 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 31893
I20260807 20:21:42.948866 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:42.949083 30863 external_mini_cluster.cc:1428] Setting key 1644dc1882a92f77d5874d4d0d288d74
I20260807 20:21:42.950498 32001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76: Bootstrap starting.
I20260807 20:21:42.951236 32001 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:42.951522 32001 log.cc:824] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:42.952256 32001 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76: No bootstrap required, opened a new log
I20260807 20:21:42.954536 32001 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d67383616148439001af3aee767c76" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44967 } }
I20260807 20:21:42.954722 32001 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:42.954761 32001 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95d67383616148439001af3aee767c76, State: Initialized, Role: FOLLOWER
I20260807 20:21:42.954900 32001 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d67383616148439001af3aee767c76" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44967 } }
I20260807 20:21:42.954996 32001 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:42.955037 32001 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:42.955087 32001 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:42.955753 32001 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d67383616148439001af3aee767c76" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44967 } }
I20260807 20:21:42.955848 32001 leader_election.cc:302] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95d67383616148439001af3aee767c76; no voters:
I20260807 20:21:42.956004 32001 leader_election.cc:288] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:42.956058 32008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [term 1 FOLLOWER]: Leader election won for term 1
Aug 07 20:21:42 dist-test-slave-t7g5 krb5kdc[31878](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:42.956213 32008 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [term 1 LEADER]: Becoming Leader. State: Replica: 95d67383616148439001af3aee767c76, State: Running, Role: LEADER
I20260807 20:21:42.956262 32001 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:42.956310 32008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d67383616148439001af3aee767c76" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44967 } }
I20260807 20:21:42.956615 32008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95d67383616148439001af3aee767c76. Latest consensus state: current_term: 1 leader_uuid: "95d67383616148439001af3aee767c76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d67383616148439001af3aee767c76" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44967 } } }
I20260807 20:21:42.956744 32008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:42.957187 32020 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:42.957759 32020 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:42.957796 32009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95d67383616148439001af3aee767c76" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d67383616148439001af3aee767c76" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44967 } } }
I20260807 20:21:42.959174 32009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:42.959355 32020 catalog_manager.cc:1347] Generated new cluster ID: 30af9dbfaffc4b2caf7177988e16acbd
I20260807 20:21:42.959400 32020 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:42.960587 32005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:42.949688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45013 (local address 127.30.35.254:44967)
0807 20:21:42.949875 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:42.949883 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:42.949909 (+ 26us) server_negotiation.cc:407] Connection header received
0807 20:21:42.950341 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:42.950347 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:42.950394 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:42.950510 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:42.951339 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:42.952413 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:42.953425 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:42.953886 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:42.953966 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:42.956848 (+ 2882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:42.956853 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:42.956853 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:42.956867 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:42.958937 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:42.959414 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:42.959417 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:42.959417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:42.959537 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:42.959762 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:42.959763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:42.959763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:42.960000 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:42.960145 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:42.960298 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 20:21:42.960398 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":83,"threads_started":1}
I20260807 20:21:42.961414 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:42.964306 32020 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:42.965040 32020 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:42.968621 32005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:42.962674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35119 (local address 127.30.35.254:44967)
0807 20:21:42.962710 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:42.962712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:42.962833 (+ 121us) server_negotiation.cc:407] Connection header received
0807 20:21:42.962886 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:42.962887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:42.962896 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:42.962947 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:42.963432 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:42.964297 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:42.964974 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:42.965242 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:42.965293 (+ 51us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:42.966399 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:42.966400 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:42.966400 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:42.966407 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:42.967579 (+ 1172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:42.967908 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:42.967909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:42.967909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:42.967964 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:42.968150 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:42.968150 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:42.968151 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:42.968254 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:42.968346 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:42.968480 (+ 134us) server_negotiation.cc:299] Negotiation successful
0807 20:21:42.968537 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 20:21:42.970793 32020 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95d67383616148439001af3aee767c76: Generated new TSK 0
I20260807 20:21:42.970958 32020 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:42.972920 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 31893
W20260807 20:21:42.981935 31876 connection.cc:535] client connection to 127.30.35.254:44967 recv error: Network error: failed to read from TLS socket (remote: 127.30.35.254:44967): Connection reset by peer (error 104)
2026-08-07T20:21:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1420 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:43 dist-test-slave-t7g5 krb5kdc[32046](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:43 dist-test-slave-t7g5 krb5kdc[32046](info): set up 2 sockets
Aug 07 20:21:43 dist-test-slave-t7g5 krb5kdc[32046](info): commencing operation
krb5kdc: starting...
W20260807 20:21:44.121997 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:44 dist-test-slave-t7g5 krb5kdc[32046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:21:44.242918 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:38921
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:33601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:38921
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:44.324822 32069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:44.325052 32069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:44.325073 32069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:44.326256 32069 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:44.326300 32069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:44.326313 32069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:44.326334 32069 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:44.326357 32069 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:44.327880 32069 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:33601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:38921
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:38921
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:44.328106 32069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:44.328307 32069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:44.333042 32080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:44.333077 32069 server_base.cc:1034] running on GCE node
W20260807 20:21:44.333061 32077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:44.333050 32082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:44.333446 32069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:44.333750 32069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:44.334898 32069 hybrid_clock.cc:648] HybridClock initialized: now 1786134104334879 us; error 30 us; skew 500 ppm
Aug 07 20:21:44 dist-test-slave-t7g5 krb5kdc[32046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134104, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:44.337307 32069 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:21:44.337741 32069 webserver.cc:460] Webserver started at http://127.30.35.254:42657/ using document root <none> and password file <none>
I20260807 20:21:44.337949 32069 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:44.337996 32069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:44.338120 32069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:44.339157 32069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "798af929ea35403498ba8ee7caa7b77e"
format_stamp: "Formatted at 2026-08-07 20:21:44 on dist-test-slave-t7g5"
server_key: "fd238db3f67a4f41c1d47b8f053c431f"
server_key_iv: "f494ca1d6eb7cc2462173f849e8aec4c"
server_key_version: "encryptionkey@0"
I20260807 20:21:44.339488 32069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "798af929ea35403498ba8ee7caa7b77e"
format_stamp: "Formatted at 2026-08-07 20:21:44 on dist-test-slave-t7g5"
server_key: "fd238db3f67a4f41c1d47b8f053c431f"
server_key_iv: "f494ca1d6eb7cc2462173f849e8aec4c"
server_key_version: "encryptionkey@0"
I20260807 20:21:44.340799 32069 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260807 20:21:44.341459 32094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:44.341598 32069 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:44.341712 32069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "798af929ea35403498ba8ee7caa7b77e"
format_stamp: "Formatted at 2026-08-07 20:21:44 on dist-test-slave-t7g5"
server_key: "fd238db3f67a4f41c1d47b8f053c431f"
server_key_iv: "f494ca1d6eb7cc2462173f849e8aec4c"
server_key_version: "encryptionkey@0"
I20260807 20:21:44.341774 32069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:44.365351 32069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:44.367266 32069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:44.367413 32069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:44.371177 32069 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:38921
I20260807 20:21:44.371224 32173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:38921 every 8 connection(s)
I20260807 20:21:44.371552 32069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:44.372404 32174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:44.374679 32174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e: Bootstrap starting.
I20260807 20:21:44.375204 32174 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:44.375433 32174 log.cc:824] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:44.376094 32174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e: No bootstrap required, opened a new log
I20260807 20:21:44.377583 32174 raft_consensus.cc:348] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "798af929ea35403498ba8ee7caa7b77e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38921 } }
I20260807 20:21:44.377763 32174 raft_consensus.cc:374] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:44.377795 32174 raft_consensus.cc:729] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 798af929ea35403498ba8ee7caa7b77e, State: Initialized, Role: FOLLOWER
I20260807 20:21:44.377897 32174 consensus_queue.cc:260] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "798af929ea35403498ba8ee7caa7b77e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38921 } }
I20260807 20:21:44.377955 32174 raft_consensus.cc:388] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:44.377976 32174 raft_consensus.cc:482] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:44.378007 32174 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:44.378307 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 32069
I20260807 20:21:44.378432 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:44.378675 30863 external_mini_cluster.cc:1428] Setting key d709a799dc50656bebfe51a52f166935
I20260807 20:21:44.378964 32174 raft_consensus.cc:504] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "798af929ea35403498ba8ee7caa7b77e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38921 } }
I20260807 20:21:44.379278 32174 leader_election.cc:302] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 798af929ea35403498ba8ee7caa7b77e; no voters:
I20260807 20:21:44.379456 32174 leader_election.cc:288] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:44.379492 32181 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:44.379678 32181 raft_consensus.cc:686] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [term 1 LEADER]: Becoming Leader. State: Replica: 798af929ea35403498ba8ee7caa7b77e, State: Running, Role: LEADER
I20260807 20:21:44.379738 32174 sys_catalog.cc:564] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:44.379801 32181 consensus_queue.cc:237] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "798af929ea35403498ba8ee7caa7b77e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38921 } }
I20260807 20:21:44.380183 32182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "798af929ea35403498ba8ee7caa7b77e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "798af929ea35403498ba8ee7caa7b77e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38921 } } }
I20260807 20:21:44.380208 32183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 798af929ea35403498ba8ee7caa7b77e. Latest consensus state: current_term: 1 leader_uuid: "798af929ea35403498ba8ee7caa7b77e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "798af929ea35403498ba8ee7caa7b77e" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 38921 } } }
I20260807 20:21:44.380434 32182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:44.380441 32183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e [sys.catalog]: This master's current role is: LEADER
W20260807 20:21:44.381790 32207 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:21:44.381839 32207 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:21:44.381942 32196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:44.382129 32196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:44.383597 32196 catalog_manager.cc:1347] Generated new cluster ID: 554f43ca40b84148a911b233c23b9257
I20260807 20:21:44.383654 32196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:44.384491 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:44.379103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34761 (local address 127.30.35.254:38921)
0807 20:21:44.379280 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:44.379288 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:44.379315 (+ 27us) server_negotiation.cc:407] Connection header received
0807 20:21:44.379434 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:44.379441 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:44.379501 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:44.379647 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:44.380002 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:44.381427 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:44.382472 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:44.382979 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:44.383089 (+ 110us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:44.383753 (+ 664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:44.383757 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:44.383757 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:44.383948 (+ 191us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:44.383985 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:44.383999 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:44.384072 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:44.384209 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 20:21:44.384245 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":127,"thread_start_us":85,"threads_started":1}
I20260807 20:21:44.390421 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:44.391690 32196 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:44.392150 32196 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:44.395697 32196 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 798af929ea35403498ba8ee7caa7b77e: Generated new TSK 0
I20260807 20:21:44.395845 32196 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:44.397203 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:44.393935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35073 (local address 127.30.35.254:38921)
0807 20:21:44.393974 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:44.393976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:44.394085 (+ 109us) server_negotiation.cc:407] Connection header received
0807 20:21:44.394132 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:44.394133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:44.394143 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:44.394197 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:44.394352 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:44.395123 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:44.396187 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:44.396387 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:44.396439 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:44.396989 (+ 550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:44.396990 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:44.396991 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:44.396994 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:44.397006 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:44.397010 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:44.397052 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:44.397127 (+ 75us) server_negotiation.cc:299] Negotiation successful
0807 20:21:44.397137 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:21:44.398856 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 32069
W20260807 20:21:44.413385 32044 connection.cc:535] client connection to 127.30.35.254:38921 recv error: Network error: failed to read from TLS socket (remote: 127.30.35.254:38921): Connection reset by peer (error 104)
2026-08-07T20:21:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1431 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:44 dist-test-slave-t7g5 krb5kdc[32220](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:44 dist-test-slave-t7g5 krb5kdc[32220](info): set up 2 sockets
Aug 07 20:21:44 dist-test-slave-t7g5 krb5kdc[32220](info): commencing operation
krb5kdc: starting...
W20260807 20:21:45.548938 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:45 dist-test-slave-t7g5 krb5kdc[32220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134105, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:21:45.668334 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:43081
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:45159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:43081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:45.749310 32239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:45.749523 32239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:45.749545 32239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:45.750741 32239 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:45.750787 32239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:45.750804 32239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:45.750816 32239 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:45.750828 32239 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:45.752286 32239 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:45159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:43081
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:43081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:45.752526 32239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:45.752728 32239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:45.757337 32249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:45.757361 32245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:45.757382 32255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:45.757552 32239 server_base.cc:1034] running on GCE node
I20260807 20:21:45.757829 32239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:45.758109 32239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:45.759280 32239 hybrid_clock.cc:648] HybridClock initialized: now 1786134105759254 us; error 37 us; skew 500 ppm
Aug 07 20:21:45 dist-test-slave-t7g5 krb5kdc[32220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134105, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:45.772411 32239 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:21:45.772981 32239 webserver.cc:460] Webserver started at http://127.30.35.254:42431/ using document root <none> and password file <none>
I20260807 20:21:45.773236 32239 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:45.773289 32239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:45.773425 32239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:45.774557 32239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "d198d6cf3d934fb5b12d5abfed9be1c7"
format_stamp: "Formatted at 2026-08-07 20:21:45 on dist-test-slave-t7g5"
server_key: "d41e8fbaccd27eccdff9ffb3a40d9899"
server_key_iv: "5a986188b492cb0c13b82993b98e9c88"
server_key_version: "encryptionkey@0"
I20260807 20:21:45.774915 32239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "d198d6cf3d934fb5b12d5abfed9be1c7"
format_stamp: "Formatted at 2026-08-07 20:21:45 on dist-test-slave-t7g5"
server_key: "d41e8fbaccd27eccdff9ffb3a40d9899"
server_key_iv: "5a986188b492cb0c13b82993b98e9c88"
server_key_version: "encryptionkey@0"
I20260807 20:21:45.776242 32239 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260807 20:21:45.776935 32266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:45.777113 32239 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:21:45.777205 32239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "d198d6cf3d934fb5b12d5abfed9be1c7"
format_stamp: "Formatted at 2026-08-07 20:21:45 on dist-test-slave-t7g5"
server_key: "d41e8fbaccd27eccdff9ffb3a40d9899"
server_key_iv: "5a986188b492cb0c13b82993b98e9c88"
server_key_version: "encryptionkey@0"
I20260807 20:21:45.777269 32239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:45.780725 32239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:45.782903 32239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:45.783038 32239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:45.786854 32239 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:43081
I20260807 20:21:45.786914 32347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:43081 every 8 connection(s)
I20260807 20:21:45.787266 32239 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:45.788338 32348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:45.790622 32348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7: Bootstrap starting.
I20260807 20:21:45.791195 32348 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:45.791452 32348 log.cc:824] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:45.792138 32348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7: No bootstrap required, opened a new log
I20260807 20:21:45.793510 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 32239
I20260807 20:21:45.793620 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:45.793825 30863 external_mini_cluster.cc:1428] Setting key fe34a590e6f854e6f5d3d5998e27b2b3
I20260807 20:21:45.793772 32348 raft_consensus.cc:348] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d198d6cf3d934fb5b12d5abfed9be1c7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43081 } }
I20260807 20:21:45.793936 32348 raft_consensus.cc:374] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:45.793980 32348 raft_consensus.cc:729] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d198d6cf3d934fb5b12d5abfed9be1c7, State: Initialized, Role: FOLLOWER
I20260807 20:21:45.794121 32348 consensus_queue.cc:260] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d198d6cf3d934fb5b12d5abfed9be1c7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43081 } }
I20260807 20:21:45.794204 32348 raft_consensus.cc:388] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:45.794242 32348 raft_consensus.cc:482] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:45.794282 32348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:45.794883 32348 raft_consensus.cc:504] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d198d6cf3d934fb5b12d5abfed9be1c7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43081 } }
I20260807 20:21:45.795002 32348 leader_election.cc:302] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d198d6cf3d934fb5b12d5abfed9be1c7; no voters:
I20260807 20:21:45.795171 32348 leader_election.cc:288] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:45.795256 32362 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:45.795429 32348 sys_catalog.cc:564] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:45.795433 32362 raft_consensus.cc:686] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [term 1 LEADER]: Becoming Leader. State: Replica: d198d6cf3d934fb5b12d5abfed9be1c7, State: Running, Role: LEADER
I20260807 20:21:45.795634 32362 consensus_queue.cc:237] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d198d6cf3d934fb5b12d5abfed9be1c7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43081 } }
I20260807 20:21:45.796002 32364 sys_catalog.cc:455] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d198d6cf3d934fb5b12d5abfed9be1c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d198d6cf3d934fb5b12d5abfed9be1c7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43081 } } }
I20260807 20:21:45.796103 32364 sys_catalog.cc:458] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:45.796020 32366 sys_catalog.cc:455] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d198d6cf3d934fb5b12d5abfed9be1c7. Latest consensus state: current_term: 1 leader_uuid: "d198d6cf3d934fb5b12d5abfed9be1c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d198d6cf3d934fb5b12d5abfed9be1c7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 43081 } } }
I20260807 20:21:45.796190 32366 sys_catalog.cc:458] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:45.796404 32357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:45.794268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56113 (local address 127.30.35.254:43081)
0807 20:21:45.794461 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:45.794471 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:45.794498 (+ 27us) server_negotiation.cc:407] Connection header received
0807 20:21:45.794828 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:45.794834 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:45.794859 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:45.794975 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:45.795797 (+ 822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:45.795800 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:45.795800 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:45.795805 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:45.795861 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:45.795878 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:45.795952 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:45.796128 (+ 176us) server_negotiation.cc:299] Negotiation successful
0807 20:21:45.796179 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":92,"threads_started":1}
I20260807 20:21:45.796643 32375 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:45.797127 32375 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:45.797513 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:45.799059 32375 catalog_manager.cc:1347] Generated new cluster ID: 85855c75a73443adaebc145aee820207
I20260807 20:21:45.799114 32375 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:45.800122 32357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:45.798867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51899 (local address 127.30.35.254:43081)
0807 20:21:45.798901 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:45.798903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:45.799159 (+ 256us) server_negotiation.cc:407] Connection header received
0807 20:21:45.799253 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:45.799254 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:45.799260 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:45.799285 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:45.799917 (+ 632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:45.799918 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:45.799918 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:45.799922 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:45.799936 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:45.799940 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:45.799964 (+ 24us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:45.800044 (+ 80us) server_negotiation.cc:299] Negotiation successful
0807 20:21:45.800056 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 20:21:45.807303 32375 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:45.807476 32375 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:45.817399 32375 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d198d6cf3d934fb5b12d5abfed9be1c7: Generated new TSK 0
I20260807 20:21:45.817615 32375 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:45.819927 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 32239
2026-08-07T20:21:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1420 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:45 dist-test-slave-t7g5 krb5kdc[32399](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:45 dist-test-slave-t7g5 krb5kdc[32399](info): set up 2 sockets
Aug 07 20:21:45 dist-test-slave-t7g5 krb5kdc[32399](info): commencing operation
krb5kdc: starting...
W20260807 20:21:46.973536 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:47 dist-test-slave-t7g5 krb5kdc[32399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134107, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:21:47.097026 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:32901
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:34923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:32901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:47.179131 32417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:47.179344 32417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:47.179368 32417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:47.180461 32417 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:47.180496 32417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:47.180508 32417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:47.180519 32417 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:47.180534 32417 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:47.181986 32417 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:34923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:32901
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:32901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:47.182188 32417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:47.182358 32417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:47.186856 32430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:47.186864 32427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:47.186914 32428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:47.187151 32417 server_base.cc:1034] running on GCE node
I20260807 20:21:47.187415 32417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:47.187680 32417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:47.188815 32417 hybrid_clock.cc:648] HybridClock initialized: now 1786134107188801 us; error 41 us; skew 500 ppm
Aug 07 20:21:47 dist-test-slave-t7g5 krb5kdc[32399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134107, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:47.191303 32417 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:21:47.191744 32417 webserver.cc:460] Webserver started at http://127.30.35.254:35087/ using document root <none> and password file <none>
I20260807 20:21:47.191982 32417 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:47.192028 32417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:47.192154 32417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:47.193200 32417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "db6de4bf93394dc2b11864ff6cf81d3d"
format_stamp: "Formatted at 2026-08-07 20:21:47 on dist-test-slave-t7g5"
server_key: "17da87d2f889a01359327a8304747955"
server_key_iv: "89d01555e17d81d1a5af89893b5c5de5"
server_key_version: "encryptionkey@0"
I20260807 20:21:47.193533 32417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "db6de4bf93394dc2b11864ff6cf81d3d"
format_stamp: "Formatted at 2026-08-07 20:21:47 on dist-test-slave-t7g5"
server_key: "17da87d2f889a01359327a8304747955"
server_key_iv: "89d01555e17d81d1a5af89893b5c5de5"
server_key_version: "encryptionkey@0"
I20260807 20:21:47.194798 32417 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260807 20:21:47.195505 32442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:47.195647 32417 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:21:47.195734 32417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "db6de4bf93394dc2b11864ff6cf81d3d"
format_stamp: "Formatted at 2026-08-07 20:21:47 on dist-test-slave-t7g5"
server_key: "17da87d2f889a01359327a8304747955"
server_key_iv: "89d01555e17d81d1a5af89893b5c5de5"
server_key_version: "encryptionkey@0"
I20260807 20:21:47.195796 32417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:47.211783 32417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:47.213788 32417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:47.213917 32417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:47.217692 32417 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:32901
I20260807 20:21:47.217752 32534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:32901 every 8 connection(s)
I20260807 20:21:47.218091 32417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:47.219089 32535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:47.221437 32535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d: Bootstrap starting.
I20260807 20:21:47.222045 32535 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:47.222119 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 32417
I20260807 20:21:47.222231 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:47.222349 32535 log.cc:824] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:47.222420 30863 external_mini_cluster.cc:1428] Setting key 3df0adf8d2a38a39731850a92e5e537f
I20260807 20:21:47.223165 32535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d: No bootstrap required, opened a new log
I20260807 20:21:47.225726 32535 raft_consensus.cc:348] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db6de4bf93394dc2b11864ff6cf81d3d" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 32901 } }
I20260807 20:21:47.225906 32535 raft_consensus.cc:374] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:47.225943 32535 raft_consensus.cc:729] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db6de4bf93394dc2b11864ff6cf81d3d, State: Initialized, Role: FOLLOWER
I20260807 20:21:47.226080 32535 consensus_queue.cc:260] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db6de4bf93394dc2b11864ff6cf81d3d" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 32901 } }
I20260807 20:21:47.226150 32535 raft_consensus.cc:388] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:47.226181 32535 raft_consensus.cc:482] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:47.226220 32535 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:47.226805 32535 raft_consensus.cc:504] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db6de4bf93394dc2b11864ff6cf81d3d" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 32901 } }
I20260807 20:21:47.226914 32535 leader_election.cc:302] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db6de4bf93394dc2b11864ff6cf81d3d; no voters:
I20260807 20:21:47.227072 32535 leader_election.cc:288] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:47.227128 32541 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:47.227312 32541 raft_consensus.cc:686] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [term 1 LEADER]: Becoming Leader. State: Replica: db6de4bf93394dc2b11864ff6cf81d3d, State: Running, Role: LEADER
I20260807 20:21:47.227324 32535 sys_catalog.cc:564] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:47.227423 32541 consensus_queue.cc:237] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db6de4bf93394dc2b11864ff6cf81d3d" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 32901 } }
I20260807 20:21:47.227815 32542 sys_catalog.cc:455] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db6de4bf93394dc2b11864ff6cf81d3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db6de4bf93394dc2b11864ff6cf81d3d" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 32901 } } }
I20260807 20:21:47.227866 32543 sys_catalog.cc:455] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader db6de4bf93394dc2b11864ff6cf81d3d. Latest consensus state: current_term: 1 leader_uuid: "db6de4bf93394dc2b11864ff6cf81d3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db6de4bf93394dc2b11864ff6cf81d3d" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 32901 } } }
I20260807 20:21:47.227905 32542 sys_catalog.cc:458] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:47.227941 32543 sys_catalog.cc:458] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:47.228132 32550 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:47.228652 32550 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 07 20:21:47 dist-test-slave-t7g5 krb5kdc[32399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134107, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:47.235162 32539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:47.222894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42729 (local address 127.30.35.254:32901)
0807 20:21:47.223091 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:47.223102 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:47.223135 (+ 33us) server_negotiation.cc:407] Connection header received
0807 20:21:47.223629 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:47.223640 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:47.223708 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:47.223864 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:47.224488 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:47.225914 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:47.226758 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:47.227646 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:47.227748 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:47.231810 (+ 4062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:47.231815 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:47.231816 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:47.231830 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:47.233549 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:47.233969 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:47.233973 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:47.233973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:47.234070 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:47.234275 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:47.234276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:47.234276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:47.234531 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:47.234706 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:47.234833 (+ 127us) server_negotiation.cc:299] Negotiation successful
0807 20:21:47.234977 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":81,"threads_started":1}
I20260807 20:21:47.236275 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:47.236366 32550 catalog_manager.cc:1347] Generated new cluster ID: e56b3f99bb6243ff899d48ce11d6ad68
I20260807 20:21:47.236419 32550 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:47.243628 32539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:47.237768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58373 (local address 127.30.35.254:32901)
0807 20:21:47.237803 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:47.237805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:47.237813 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:21:47.237859 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:47.237860 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:47.237871 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:47.237928 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:47.238457 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:47.238956 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:47.239662 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:47.239887 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:47.239952 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:47.241117 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:47.241118 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:47.241118 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:47.241126 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:47.242528 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:47.242877 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:47.242878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:47.242878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:47.242938 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:47.243122 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:47.243123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:47.243123 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:47.243244 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:47.243339 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:47.243463 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 20:21:47.243540 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 20:21:47.258106 32550 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:47.258783 32550 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:47.261890 32550 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db6de4bf93394dc2b11864ff6cf81d3d: Generated new TSK 0
I20260807 20:21:47.262074 32550 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:47.269423 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 32417
2026-08-07T20:21:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1445 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:47 dist-test-slave-t7g5 krb5kdc[32576](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:47 dist-test-slave-t7g5 krb5kdc[32576](info): set up 2 sockets
Aug 07 20:21:47 dist-test-slave-t7g5 krb5kdc[32576](info): commencing operation
krb5kdc: starting...
W20260807 20:21:48.419528 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:48 dist-test-slave-t7g5 krb5kdc[32576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:21:48.538117 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:45303
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:37755
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:45303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:48.619437 32602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:48.619658 32602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:48.619679 32602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:48.620813 32602 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:48.620865 32602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:48.620878 32602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:48.620901 32602 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:48.620918 32602 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:48.622478 32602 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:37755
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:45303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:45303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:48.622715 32602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:48.622932 32602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:48.627570 32611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:48.627534 32609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:48.627543 32608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:48.627750 32602 server_base.cc:1034] running on GCE node
I20260807 20:21:48.628026 32602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:48.628304 32602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:48.629447 32602 hybrid_clock.cc:648] HybridClock initialized: now 1786134108629434 us; error 30 us; skew 500 ppm
Aug 07 20:21:48 dist-test-slave-t7g5 krb5kdc[32576](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134108, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:48.631994 32602 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:21:48.632397 32602 webserver.cc:460] Webserver started at http://127.30.35.254:40489/ using document root <none> and password file <none>
I20260807 20:21:48.632572 32602 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:48.632611 32602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:48.632704 32602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:48.633747 32602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "62d860a3e71f40b2aaf99faa6f2571f7"
format_stamp: "Formatted at 2026-08-07 20:21:48 on dist-test-slave-t7g5"
server_key: "30880931ff94fb382de1c60c7dbdd3b7"
server_key_iv: "f6f1d21d67e1b3b10f63f78c4afd9686"
server_key_version: "encryptionkey@0"
I20260807 20:21:48.634060 32602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "62d860a3e71f40b2aaf99faa6f2571f7"
format_stamp: "Formatted at 2026-08-07 20:21:48 on dist-test-slave-t7g5"
server_key: "30880931ff94fb382de1c60c7dbdd3b7"
server_key_iv: "f6f1d21d67e1b3b10f63f78c4afd9686"
server_key_version: "encryptionkey@0"
I20260807 20:21:48.635255 32602 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:21:48.635938 32624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:48.636109 32602 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:48.636202 32602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "62d860a3e71f40b2aaf99faa6f2571f7"
format_stamp: "Formatted at 2026-08-07 20:21:48 on dist-test-slave-t7g5"
server_key: "30880931ff94fb382de1c60c7dbdd3b7"
server_key_iv: "f6f1d21d67e1b3b10f63f78c4afd9686"
server_key_version: "encryptionkey@0"
I20260807 20:21:48.636260 32602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:48.658254 32602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:48.660560 32602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:48.660674 32602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:48.664522 32602 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:45303
I20260807 20:21:48.664561 32713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:45303 every 8 connection(s)
I20260807 20:21:48.664887 32602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:48.665808 32715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:48.668066 32715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7: Bootstrap starting.
I20260807 20:21:48.668638 32715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:48.668896 32715 log.cc:824] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:48.669593 32715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7: No bootstrap required, opened a new log
I20260807 20:21:48.671152 32715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62d860a3e71f40b2aaf99faa6f2571f7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45303 } }
I20260807 20:21:48.671329 32715 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:48.671352 32715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62d860a3e71f40b2aaf99faa6f2571f7, State: Initialized, Role: FOLLOWER
I20260807 20:21:48.671489 32715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62d860a3e71f40b2aaf99faa6f2571f7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45303 } }
I20260807 20:21:48.671553 32715 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:48.671574 32715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:48.671622 32715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:48.672451 32715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62d860a3e71f40b2aaf99faa6f2571f7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45303 } }
I20260807 20:21:48.672541 32715 leader_election.cc:302] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62d860a3e71f40b2aaf99faa6f2571f7; no voters:
I20260807 20:21:48.672690 32715 leader_election.cc:288] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:48.672736 32719 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:48.672904 32719 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [term 1 LEADER]: Becoming Leader. State: Replica: 62d860a3e71f40b2aaf99faa6f2571f7, State: Running, Role: LEADER
I20260807 20:21:48.672958 32715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:48.672995 32719 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62d860a3e71f40b2aaf99faa6f2571f7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45303 } }
I20260807 20:21:48.673135 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 32602
I20260807 20:21:48.673265 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:48.673445 30863 external_mini_cluster.cc:1428] Setting key 1aa2231bd5bed11207cbec265797f99d
I20260807 20:21:48.673489 32720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62d860a3e71f40b2aaf99faa6f2571f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62d860a3e71f40b2aaf99faa6f2571f7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45303 } } }
I20260807 20:21:48.673568 32720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:48.674418 32727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:48.674419 32723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62d860a3e71f40b2aaf99faa6f2571f7. Latest consensus state: current_term: 1 leader_uuid: "62d860a3e71f40b2aaf99faa6f2571f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62d860a3e71f40b2aaf99faa6f2571f7" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 45303 } } }
I20260807 20:21:48.674845 32723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:48.675181 32727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:48.676508 32727 catalog_manager.cc:1347] Generated new cluster ID: 8db1752ccd1d47a28582966f9d900153
I20260807 20:21:48.676566 32727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:48.679827 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:48.674090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37859 (local address 127.30.35.254:45303)
0807 20:21:48.674302 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:48.674313 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:48.674355 (+ 42us) server_negotiation.cc:407] Connection header received
0807 20:21:48.674492 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:48.674501 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:48.674563 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:48.674752 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:48.674999 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:48.676426 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:48.677533 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:48.678285 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:48.678397 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:48.679120 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:48.679125 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:48.679125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:48.679353 (+ 228us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:48.679393 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:48.679408 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:48.679475 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:48.679538 (+ 63us) server_negotiation.cc:299] Negotiation successful
0807 20:21:48.679605 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":82,"threads_started":1}
I20260807 20:21:48.680787 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:48.689371 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:48.682514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45315 (local address 127.30.35.254:45303)
0807 20:21:48.682565 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:48.682567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:48.685833 (+ 3266us) server_negotiation.cc:407] Connection header received
0807 20:21:48.685923 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:48.685924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:48.685937 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:48.685992 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:48.686138 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:48.686940 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:48.687942 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:48.688273 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:48.688343 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:48.689068 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:48.689069 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:48.689070 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:48.689075 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:48.689090 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:48.689094 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:48.689141 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:48.689245 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 20:21:48.689282 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260807 20:21:48.689563 32727 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:48.690215 32727 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:48.695674 32727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62d860a3e71f40b2aaf99faa6f2571f7: Generated new TSK 0
I20260807 20:21:48.695883 32727 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:48.700605 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 32602
2026-08-07T20:21:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1439 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:48 dist-test-slave-t7g5 krb5kdc[302](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:48 dist-test-slave-t7g5 krb5kdc[302](info): set up 2 sockets
Aug 07 20:21:48 dist-test-slave-t7g5 krb5kdc[302](info): commencing operation
krb5kdc: starting...
W20260807 20:21:49.840435 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:49 dist-test-slave-t7g5 krb5kdc[302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:21:49.958748 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:44187
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:40899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:44187
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:50.039062 329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:50.039284 329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:50.039314 329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:50.040469 329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:50.040515 329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:50.040534 329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:50.040550 329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:50.040566 329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:50.042073 329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:40899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:44187
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:44187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:50.042330 329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:50.042548 329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:50.047376 341 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:50.047407 336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:50.047437 329 server_base.cc:1034] running on GCE node
W20260807 20:21:50.047402 337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:50.047899 329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:50.048202 329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:50.049346 329 hybrid_clock.cc:648] HybridClock initialized: now 1786134110049327 us; error 39 us; skew 500 ppm
Aug 07 20:21:50 dist-test-slave-t7g5 krb5kdc[302](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134110, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:50.051990 329 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:21:50.052435 329 webserver.cc:460] Webserver started at http://127.30.35.254:41815/ using document root <none> and password file <none>
I20260807 20:21:50.052646 329 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:50.052691 329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:50.052845 329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:50.054005 329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "c93e85093c814362a487d26979227f46"
format_stamp: "Formatted at 2026-08-07 20:21:50 on dist-test-slave-t7g5"
server_key: "813399d6c9ac934190560beeb4b951f1"
server_key_iv: "a2d0f72a0a1d00349ddc82797b9d80be"
server_key_version: "encryptionkey@0"
I20260807 20:21:50.054351 329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "c93e85093c814362a487d26979227f46"
format_stamp: "Formatted at 2026-08-07 20:21:50 on dist-test-slave-t7g5"
server_key: "813399d6c9ac934190560beeb4b951f1"
server_key_iv: "a2d0f72a0a1d00349ddc82797b9d80be"
server_key_version: "encryptionkey@0"
I20260807 20:21:50.055698 329 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260807 20:21:50.056385 352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:50.056576 329 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:50.056666 329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "c93e85093c814362a487d26979227f46"
format_stamp: "Formatted at 2026-08-07 20:21:50 on dist-test-slave-t7g5"
server_key: "813399d6c9ac934190560beeb4b951f1"
server_key_iv: "a2d0f72a0a1d00349ddc82797b9d80be"
server_key_version: "encryptionkey@0"
I20260807 20:21:50.056730 329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:50.060074 329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:50.061936 329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:50.062072 329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:50.065842 329 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:44187
I20260807 20:21:50.065989 425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:44187 every 8 connection(s)
I20260807 20:21:50.066213 329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:50.067180 427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:50.069442 427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46: Bootstrap starting.
I20260807 20:21:50.070034 427 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:50.070276 427 log.cc:824] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:50.070917 427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46: No bootstrap required, opened a new log
I20260807 20:21:50.072482 427 raft_consensus.cc:348] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c93e85093c814362a487d26979227f46" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44187 } }
I20260807 20:21:50.072628 427 raft_consensus.cc:374] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 20:21:50.072659 427 raft_consensus.cc:729] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c93e85093c814362a487d26979227f46, State: Initialized, Role: FOLLOWER
I20260807 20:21:50.072767 427 consensus_queue.cc:260] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c93e85093c814362a487d26979227f46" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44187 } }
I20260807 20:21:50.072845 427 raft_consensus.cc:388] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 20:21:50.072875 427 raft_consensus.cc:482] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 20:21:50.072911 427 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:50.073144 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 329
I20260807 20:21:50.073259 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:50.073446 30863 external_mini_cluster.cc:1428] Setting key ab19b3fce386b96bba7c21c49e937bdb
I20260807 20:21:50.073887 427 raft_consensus.cc:504] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c93e85093c814362a487d26979227f46" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44187 } }
I20260807 20:21:50.074008 427 leader_election.cc:302] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c93e85093c814362a487d26979227f46; no voters:
I20260807 20:21:50.074190 427 leader_election.cc:288] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 20:21:50.074232 434 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:50.074419 434 raft_consensus.cc:686] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [term 1 LEADER]: Becoming Leader. State: Replica: c93e85093c814362a487d26979227f46, State: Running, Role: LEADER
I20260807 20:21:50.074496 427 sys_catalog.cc:564] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:50.074535 434 consensus_queue.cc:237] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c93e85093c814362a487d26979227f46" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44187 } }
I20260807 20:21:50.075328 437 sys_catalog.cc:455] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c93e85093c814362a487d26979227f46. Latest consensus state: current_term: 1 leader_uuid: "c93e85093c814362a487d26979227f46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c93e85093c814362a487d26979227f46" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44187 } } }
I20260807 20:21:50.075431 437 sys_catalog.cc:458] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:50.075771 436 sys_catalog.cc:455] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c93e85093c814362a487d26979227f46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c93e85093c814362a487d26979227f46" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 44187 } } }
I20260807 20:21:50.075855 436 sys_catalog.cc:458] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46 [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:50.075941 433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:50.073955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43431 (local address 127.30.35.254:44187)
0807 20:21:50.074168 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:50.074178 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:50.074216 (+ 38us) server_negotiation.cc:407] Connection header received
0807 20:21:50.074343 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:50.074351 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:50.074386 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:50.074830 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:50.075286 (+ 456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:50.075290 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:50.075290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:50.075294 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:50.075337 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:50.075351 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:50.075642 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:50.075675 (+ 33us) server_negotiation.cc:299] Negotiation successful
0807 20:21:50.075716 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":99,"threads_started":1}
W20260807 20:21:50.076609 456 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:21:50.076668 456 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:21:50.076753 448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:50.076849 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:50.076965 448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:50.078315 448 catalog_manager.cc:1347] Generated new cluster ID: 89b4efc648994a55b195b545e326f6a8
I20260807 20:21:50.078366 448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:50.079501 433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:50.078317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41623 (local address 127.30.35.254:44187)
0807 20:21:50.078354 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:50.078356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:50.078594 (+ 238us) server_negotiation.cc:407] Connection header received
0807 20:21:50.078677 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:50.078678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:50.078683 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:50.078706 (+ 23us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:50.079298 (+ 592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:50.079299 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:50.079300 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 20:21:50.079303 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:50.079316 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 20:21:50.079320 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:50.079346 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:50.079428 (+ 82us) server_negotiation.cc:299] Negotiation successful
0807 20:21:50.079441 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260807 20:21:50.109225 448 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:50.109448 448 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:50.117486 448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c93e85093c814362a487d26979227f46: Generated new TSK 0
I20260807 20:21:50.117712 448 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:50.125139 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 329
2026-08-07T20:21:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1417 ms)
[----------] 18 tests from AuthTokenIssuingTest (25661 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:50 dist-test-slave-t7g5 krb5kdc[472](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:50 dist-test-slave-t7g5 krb5kdc[472](info): set up 2 sockets
Aug 07 20:21:50 dist-test-slave-t7g5 krb5kdc[472](info): commencing operation
krb5kdc: starting...
W20260807 20:21:51.270372 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:21:51.387845 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:39271
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:41609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:39271,127.30.35.253:41399,127.30.35.252:38499
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:51.467239 498 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 20:21:51.467466 498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:51.467492 498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:51.467515 498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:51.468605 498 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:51.468647 498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:51.468663 498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:51.468679 498 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:51.468694 498 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:51.470149 498 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:41609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:39271,127.30.35.253:41399,127.30.35.252:38499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:39271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:51.470397 498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:51.470603 498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:51.475811 506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:51.475818 507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:51.476416 498 server_base.cc:1034] running on GCE node
W20260807 20:21:51.477775 511 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:51.478166 498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:51.478539 498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:51.479689 498 hybrid_clock.cc:648] HybridClock initialized: now 1786134111479673 us; error 32 us; skew 500 ppm
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:51.486146 498 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:21:51.486548 498 webserver.cc:460] Webserver started at http://127.30.35.254:41219/ using document root <none> and password file <none>
I20260807 20:21:51.486726 498 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:51.486764 498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:51.486860 498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:51.487914 498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "d701f46266fa47bfb01d565b853125af"
format_stamp: "Formatted at 2026-08-07 20:21:51 on dist-test-slave-t7g5"
server_key: "1c7d2fbb4922c8ca00b9393e1bf91156"
server_key_iv: "65ba89701f27cedf699638bcdccaac00"
server_key_version: "encryptionkey@0"
I20260807 20:21:51.488210 498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "d701f46266fa47bfb01d565b853125af"
format_stamp: "Formatted at 2026-08-07 20:21:51 on dist-test-slave-t7g5"
server_key: "1c7d2fbb4922c8ca00b9393e1bf91156"
server_key_iv: "65ba89701f27cedf699638bcdccaac00"
server_key_version: "encryptionkey@0"
I20260807 20:21:51.489413 498 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260807 20:21:51.490128 520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:51.490278 498 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:51.490366 498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "d701f46266fa47bfb01d565b853125af"
format_stamp: "Formatted at 2026-08-07 20:21:51 on dist-test-slave-t7g5"
server_key: "1c7d2fbb4922c8ca00b9393e1bf91156"
server_key_iv: "65ba89701f27cedf699638bcdccaac00"
server_key_version: "encryptionkey@0"
I20260807 20:21:51.490424 498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:51.515620 498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:51.517618 498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:51.517810 498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:51.521667 498 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:39271
I20260807 20:21:51.521723 594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:39271 every 8 connection(s)
I20260807 20:21:51.522084 498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:51.522419 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 498
I20260807 20:21:51.522540 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:51.522754 30863 external_mini_cluster.cc:1428] Setting key 365705916308e2e02a93131431d33b7c
I20260807 20:21:51.523370 595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:51.525296 595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.30.35.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.253@KRBTEST.COM" created.
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:51.537858 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.526043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39271 (local address 127.0.0.1:60816)
0807 20:21:51.526215 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.526261 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:51.526743 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:51.527024 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:51.527027 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:51.527322 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:51.527481 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.527486 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.528491 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.528492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.529174 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.529176 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.529698 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.529699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.529764 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.530290 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:51.530300 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:51.534260 (+ 3960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:51.536274 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.536283 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.536285 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.536497 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.536742 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.536743 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.536743 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.536832 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.537223 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:51.537228 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:51.537294 (+ 66us) client_negotiation.cc:769] Sending connection context
0807 20:21:51.537378 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 20:21:51.537562 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":77,"threads_started":1}
I20260807 20:21:51.537858 601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.526093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60816 (local address 127.30.35.254:39271)
0807 20:21:51.526273 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.526278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.526346 (+ 68us) server_negotiation.cc:407] Connection header received
0807 20:21:51.526905 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.526907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.526928 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.527008 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.527578 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.528396 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.529257 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.529580 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.529704 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.534359 (+ 4655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.534383 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.534384 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.534392 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.536171 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.536574 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.536577 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.536578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.536674 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.536916 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.536916 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.536917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.537157 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.537231 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.537427 (+ 196us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.537623 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":105,"server-negotiator.queue_time_us":159,"thread_start_us":95,"threads_started":1}
I20260807 20:21:51.538908 595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:21:51.539250 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.539139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:41399 (local address 127.0.0.1:40482)
0807 20:21:51.539182 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.539227 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:41399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260807 20:21:51.539376 523 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.35.253:41399: connect: Connection refused (error 111)
I20260807 20:21:51.539790 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.539704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:41399 (local address 127.0.0.1:40498)
0807 20:21:51.539743 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.539767 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:41399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260807 20:21:51.539889 595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.253:41399: Network error: Client connection negotiation failed: client connection to 127.30.35.253:41399: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.253.keytab.
Entry for principal kudu/127.30.35.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.253.keytab.
I20260807 20:21:51.548835 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.253:41399
--webserver_interface=127.30.35.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.253.keytab
--principal=kudu/127.30.35.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:41609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:39271,127.30.35.253:41399,127.30.35.252:38499
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:21:51.589124 595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } attempt: 1
I20260807 20:21:51.589814 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.589546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:41399 (local address 127.0.0.1:40504)
0807 20:21:51.589720 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.589777 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:41399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
I20260807 20:21:51.590243 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.590120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:41399 (local address 127.0.0.1:40514)
0807 20:21:51.590172 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.590210 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:41399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 20:21:51.590368 595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.253:41399: Network error: Client connection negotiation failed: client connection to 127.30.35.253:41399: connect: Connection refused (error 111)
W20260807 20:21:51.635080 604 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 20:21:51.635283 604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:51.635298 604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:51.635317 604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:51.637105 604 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:51.637157 604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:51.637171 604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:51.637182 604 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:51.637210 604 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:51.639406 604 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:41609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:39271,127.30.35.253:41399,127.30.35.252:38499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.253.keytab
--principal=kudu/127.30.35.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.253:41399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.35.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.604
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:51.639694 604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:51.639976 604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:51.646322 613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:51.646356 615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:51.646476 604 server_base.cc:1034] running on GCE node
W20260807 20:21:51.646627 612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:51.646948 604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:51.647330 604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:51.648484 604 hybrid_clock.cc:648] HybridClock initialized: now 1786134111648459 us; error 43 us; skew 500 ppm
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:51.651309 604 init.cc:377] Logged in from keytab as kudu/127.30.35.253@KRBTEST.COM (short username kudu)
I20260807 20:21:51.651813 604 webserver.cc:460] Webserver started at http://127.30.35.253:44887/ using document root <none> and password file <none>
I20260807 20:21:51.652058 604 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:51.652118 604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:51.652247 604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:51.653288 604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/data/instance:
uuid: "f87c427ca0cd4803814750e23d0d3ed5"
format_stamp: "Formatted at 2026-08-07 20:21:51 on dist-test-slave-t7g5"
server_key: "e8087a6db950d81572c7361186fcee6a"
server_key_iv: "556f22b5d5a7a3262e3711deb87e8225"
server_key_version: "encryptionkey@0"
I20260807 20:21:51.653644 604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/wal/instance:
uuid: "f87c427ca0cd4803814750e23d0d3ed5"
format_stamp: "Formatted at 2026-08-07 20:21:51 on dist-test-slave-t7g5"
server_key: "e8087a6db950d81572c7361186fcee6a"
server_key_iv: "556f22b5d5a7a3262e3711deb87e8225"
server_key_version: "encryptionkey@0"
I20260807 20:21:51.655423 604 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260807 20:21:51.656322 627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:51.656520 604 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260807 20:21:51.656618 604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/wal
uuid: "f87c427ca0cd4803814750e23d0d3ed5"
format_stamp: "Formatted at 2026-08-07 20:21:51 on dist-test-slave-t7g5"
server_key: "e8087a6db950d81572c7361186fcee6a"
server_key_iv: "556f22b5d5a7a3262e3711deb87e8225"
server_key_version: "encryptionkey@0"
I20260807 20:21:51.656692 604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:51.658524 595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } attempt: 2
I20260807 20:21:51.658963 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.658806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:41399 (local address 127.0.0.1:40528)
0807 20:21:51.658882 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.658925 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:41399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260807 20:21:51.659296 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.659204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:41399 (local address 127.0.0.1:40534)
0807 20:21:51.659239 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.659270 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:41399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260807 20:21:51.659472 595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.253:41399: Network error: Client connection negotiation failed: client connection to 127.30.35.253:41399: connect: Connection refused (error 111)
I20260807 20:21:51.681610 604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:51.683507 604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:51.683652 604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:51.687552 604 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.253:41399
I20260807 20:21:51.687595 701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.253:41399 every 8 connection(s)
I20260807 20:21:51.687937 604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/data/info.pb
I20260807 20:21:51.688880 706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:51.690423 706 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:21:51.695784 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 604
I20260807 20:21:51.695878 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-1/wal/instance
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.253@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:51.696027 30863 external_mini_cluster.cc:1428] Setting key c2225047937af23f58ed1c3bacd6c440
I20260807 20:21:51.699121 601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.691107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60820 (local address 127.30.35.254:39271)
0807 20:21:51.691170 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.691172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.691355 (+ 183us) server_negotiation.cc:407] Connection header received
0807 20:21:51.691857 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.691858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.691875 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.691929 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.692533 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.693057 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.694108 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.694322 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.694380 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.696484 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.696485 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.696486 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.696493 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.697796 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.698168 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.698170 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.698170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.698229 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.698465 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.698466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.698466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.698598 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.698661 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.698953 (+ 292us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.699042 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260807 20:21:51.699187 709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.691057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39271 (local address 127.0.0.1:60820)
0807 20:21:51.691239 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.691275 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:51.691729 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:51.691999 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:51.692002 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:51.692247 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:51.692440 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.692443 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.693156 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.693157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.694027 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.694030 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.694407 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.694408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.694523 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.694953 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:51.694962 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:51.696375 (+ 1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:51.697871 (+ 1496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.697878 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.697880 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.698098 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.698287 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.698288 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.698288 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.698403 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.698659 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:51.698666 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:51.698785 (+ 119us) client_negotiation.cc:769] Sending connection context
0807 20:21:51.698906 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 20:21:51.699026 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":93,"threads_started":1}
I20260807 20:21:51.699797 706 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.253@KRBTEST.COM for kudu/127.30.35.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.35.252@KRBTEST.COM; defaulting to no policy
I20260807 20:21:51.706988 709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.700088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:41399 (local address 127.0.0.1:40538)
0807 20:21:51.700145 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.700156 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:51.700201 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:51.700473 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:51.700473 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:51.700621 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:51.700677 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.700678 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.701499 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.701500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.702306 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.702309 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.702984 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.702985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.703058 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.703385 (+ 327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:51.703390 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:51.704615 (+ 1225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:51.706062 (+ 1447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.706063 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.706064 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.706219 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.706421 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.706422 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.706423 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.706484 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.706723 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:51.706723 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:51.706757 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 20:21:51.706800 (+ 43us) client_negotiation.cc:240] Negotiation successful
0807 20:21:51.706866 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 20:21:51.707077 713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.700156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40538 (local address 127.30.35.253:41399)
0807 20:21:51.700342 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.700346 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.700362 (+ 16us) server_negotiation.cc:407] Connection header received
0807 20:21:51.700381 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.700382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.700393 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.700454 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.700745 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.701408 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.702397 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.702892 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.702965 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.704697 (+ 1732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.704705 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.704705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.704711 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.705995 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.706281 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.706283 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.706283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.706341 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.706538 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.706539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.706539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.706673 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.706733 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.706852 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.706924 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":81,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.252@KRBTEST.COM" created.
I20260807 20:21:51.707701 706 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:21:51.708020 709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.707918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:38499 (local address 127.0.0.1:54332)
0807 20:21:51.707960 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.708002 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260807 20:21:51.708155 633 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
I20260807 20:21:51.708554 709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.708460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:38499 (local address 127.0.0.1:54334)
0807 20:21:51.708506 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.708531 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260807 20:21:51.708652 706 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:38499: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.252.keytab.
Entry for principal kudu/127.30.35.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.252.keytab.
I20260807 20:21:51.722397 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.252:38499
--webserver_interface=127.30.35.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.252.keytab
--principal=kudu/127.30.35.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:41609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:39271,127.30.35.253:41399,127.30.35.252:38499
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:21:51.750646 595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } attempt: 3
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for kudu/127.30.35.253@KRBTEST.COM
I20260807 20:21:51.757544 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.751035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:41399 (local address 127.0.0.1:40554)
0807 20:21:51.751112 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.751123 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:51.751166 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:51.751319 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:51.751320 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:51.751495 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:51.751564 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.751566 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.752211 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.752213 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.752736 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.752737 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.753098 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.753099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.753171 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.753595 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:51.753600 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:51.754893 (+ 1293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:51.756650 (+ 1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.756651 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.756651 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.756811 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.757021 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.757022 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.757022 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.757067 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.757313 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:51.757314 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:51.757356 (+ 42us) client_negotiation.cc:769] Sending connection context
0807 20:21:51.757401 (+ 45us) client_negotiation.cc:240] Negotiation successful
0807 20:21:51.757472 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 20:21:51.757619 713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.751146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40554 (local address 127.30.35.253:41399)
0807 20:21:51.751212 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.751214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.751223 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:21:51.751249 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.751250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.751260 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.751306 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.751648 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.752133 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.752815 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.753029 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.753087 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.754967 (+ 1880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.754969 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.754969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.754977 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.756548 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.756884 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.756885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.756886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.756962 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.757118 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.757119 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.757119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.757258 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.757323 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.757444 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.757527 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 20:21:51.757942 706 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } attempt: 1
I20260807 20:21:51.758086 595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:21:51.758284 709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.758171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:38499 (local address 127.0.0.1:54344)
0807 20:21:51.758225 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.758260 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260807 20:21:51.758473 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.758290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:38499 (local address 127.0.0.1:54352)
0807 20:21:51.758402 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.758440 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260807 20:21:51.758726 709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.758638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:38499 (local address 127.0.0.1:54354)
0807 20:21:51.758671 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.758703 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260807 20:21:51.758811 706 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:38499: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
I20260807 20:21:51.758956 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.758748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:38499 (local address 127.0.0.1:54360)
0807 20:21:51.758897 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.758930 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
W20260807 20:21:51.759057 595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:38499: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
I20260807 20:21:51.790208 595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } attempt: 1
I20260807 20:21:51.790771 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.790616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:38499 (local address 127.0.0.1:54368)
0807 20:21:51.790687 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.790734 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260807 20:21:51.791186 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.791083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:38499 (local address 127.0.0.1:54384)
0807 20:21:51.791128 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.791160 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 20:21:51.791342 595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:38499: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
W20260807 20:21:51.804903 717 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 20:21:51.805105 717 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:51.805121 717 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:51.805140 717 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:51.806282 717 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:51.806325 717 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:51.806337 717 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:51.806349 717 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:51.806362 717 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:51.807794 717 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:41609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:39271,127.30.35.253:41399,127.30.35.252:38499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.252.keytab
--principal=kudu/127.30.35.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.252:38499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.35.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.717
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:51.808034 717 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:51.808240 717 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:51.812803 726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:51.812781 727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:51.813015 717 server_base.cc:1034] running on GCE node
W20260807 20:21:51.812791 729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:51.813336 717 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:51.813618 717 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:51.814796 717 hybrid_clock.cc:648] HybridClock initialized: now 1786134111814784 us; error 28 us; skew 500 ppm
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:51.817191 717 init.cc:377] Logged in from keytab as kudu/127.30.35.252@KRBTEST.COM (short username kudu)
I20260807 20:21:51.817618 717 webserver.cc:460] Webserver started at http://127.30.35.252:43945/ using document root <none> and password file <none>
I20260807 20:21:51.817869 717 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:51.817916 717 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:51.818033 717 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:51.819049 717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/data/instance:
uuid: "86ddf991c17244bd87b8c652f8becdb5"
format_stamp: "Formatted at 2026-08-07 20:21:51 on dist-test-slave-t7g5"
server_key: "6c8c22a3f45e13018fa2c28398d5f6aa"
server_key_iv: "cdf1739324407cdfca07bf1873e7dfff"
server_key_version: "encryptionkey@0"
I20260807 20:21:51.819384 717 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/wal/instance:
uuid: "86ddf991c17244bd87b8c652f8becdb5"
format_stamp: "Formatted at 2026-08-07 20:21:51 on dist-test-slave-t7g5"
server_key: "6c8c22a3f45e13018fa2c28398d5f6aa"
server_key_iv: "cdf1739324407cdfca07bf1873e7dfff"
server_key_version: "encryptionkey@0"
I20260807 20:21:51.820580 717 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260807 20:21:51.821277 742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:51.821461 717 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260807 20:21:51.821547 717 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/wal
uuid: "86ddf991c17244bd87b8c652f8becdb5"
format_stamp: "Formatted at 2026-08-07 20:21:51 on dist-test-slave-t7g5"
server_key: "6c8c22a3f45e13018fa2c28398d5f6aa"
server_key_iv: "cdf1739324407cdfca07bf1873e7dfff"
server_key_version: "encryptionkey@0"
I20260807 20:21:51.821600 717 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:51.827024 706 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } attempt: 2
I20260807 20:21:51.827430 709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.827302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:38499 (local address 127.0.0.1:54392)
0807 20:21:51.827357 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.827398 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260807 20:21:51.827734 709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.827663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:38499 (local address 127.0.0.1:54398)
0807 20:21:51.827695 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.827717 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260807 20:21:51.827811 706 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:38499: Network error: Client connection negotiation failed: client connection to 127.30.35.252:38499: connect: Connection refused (error 111)
I20260807 20:21:51.849349 717 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:51.851603 717 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:51.851716 717 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:51.855585 717 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.252:38499
I20260807 20:21:51.855640 833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.252:38499 every 8 connection(s)
I20260807 20:21:51.855989 717 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/data/info.pb
I20260807 20:21:51.856956 834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:51.857247 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 717
I20260807 20:21:51.857366 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786133844183963-30863-0/minicluster-data/master-2/wal/instance
I20260807 20:21:51.857539 30863 external_mini_cluster.cc:1428] Setting key 46a60889de74392ba588e8a9b2ffdc80
I20260807 20:21:51.858754 834 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.252@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.252@KRBTEST.COM
I20260807 20:21:51.866556 601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.859380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60828 (local address 127.30.35.254:39271)
0807 20:21:51.859439 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.859442 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.859590 (+ 148us) server_negotiation.cc:407] Connection header received
0807 20:21:51.859654 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.859655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.859666 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.859713 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.860262 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.860761 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.861695 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.861878 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.861941 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.863900 (+ 1959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.863901 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.863902 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.863910 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.865132 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.865557 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.865558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.865558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.865614 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.865854 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.865855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.865855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.865990 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.866057 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.866340 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.866421 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 20:21:51.866492 595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } attempt: 2
I20260807 20:21:51.866789 839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.859340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:39271 (local address 127.0.0.1:60828)
0807 20:21:51.859494 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.859526 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:51.859592 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:51.859729 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:51.859732 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:51.860073 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:51.860168 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.860173 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.860847 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.860848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.861595 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.861597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.861975 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.861976 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.862046 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.862479 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:51.862487 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:51.863807 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:51.865209 (+ 1402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.865216 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.865218 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.865486 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.865685 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.865685 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.865686 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.865791 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.866063 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:51.866069 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:51.866186 (+ 117us) client_negotiation.cc:769] Sending connection context
0807 20:21:51.866303 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 20:21:51.866440 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":5,"thread_start_us":91,"threads_started":1}
I20260807 20:21:51.867339 838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.858096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54404 (local address 127.30.35.252:38499)
0807 20:21:51.858304 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.858312 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.858336 (+ 24us) server_negotiation.cc:407] Connection header received
0807 20:21:51.858733 (+ 397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.858740 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.858794 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.858921 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.859682 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.860592 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.861375 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.861785 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.861883 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.864378 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.864385 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.864385 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.864391 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.865884 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.866221 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.866224 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.866224 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.866285 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.866485 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.866485 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.866486 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.866644 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.866819 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.867170 (+ 351us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.867244 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":159,"thread_start_us":93,"threads_started":1}
I20260807 20:21:51.867413 834 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for kudu/127.30.35.252@KRBTEST.COM
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.252@KRBTEST.COM for kudu/127.30.35.253@KRBTEST.COM
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:51.874378 840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.866840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54410 (local address 127.30.35.252:38499)
0807 20:21:51.867000 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.867002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.867009 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:21:51.867025 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.867026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.867035 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.867406 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.867435 (+ 29us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.868160 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.869045 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.869250 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.869302 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.871221 (+ 1919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.871222 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.871222 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.871228 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.873133 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.873506 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.873507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.873507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.873566 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.873793 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.873795 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.873795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.873925 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.873991 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.874148 (+ 157us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.874255 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":98,"threads_started":1}
I20260807 20:21:51.874524 600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.866769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:38499 (local address 127.0.0.1:54410)
0807 20:21:51.866861 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.866870 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:51.866910 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:51.867140 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:51.867141 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:51.867293 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:51.867334 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.867336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.868231 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.868232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.868990 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.868993 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.869316 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.869317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.869370 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.869715 (+ 345us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:51.869720 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:51.871140 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:51.873216 (+ 2076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.873217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.873218 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.873432 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.873644 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.873645 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.873645 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.873725 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.874002 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:51.874003 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:51.874049 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 20:21:51.874123 (+ 74us) client_negotiation.cc:240] Negotiation successful
0807 20:21:51.874431 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 20:21:51.875061 839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.867635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:41399 (local address 127.0.0.1:40562)
0807 20:21:51.867664 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.867674 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:51.867707 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:51.867941 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:51.867942 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:51.868076 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:51.868121 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.868122 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.868968 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.868969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.869723 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.869725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.870200 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.870201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.870265 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.870608 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:51.870612 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:51.871814 (+ 1202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:51.874056 (+ 2242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.874056 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.874056 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.874270 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.874474 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.874475 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.874475 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.874530 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.874804 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:51.874805 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:51.874844 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 20:21:51.874903 (+ 59us) client_negotiation.cc:240] Negotiation successful
0807 20:21:51.874985 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260807 20:21:51.875330 713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.867742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40562 (local address 127.30.35.253:41399)
0807 20:21:51.867816 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.867818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.867828 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:21:51.867853 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.867854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.867864 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.867927 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.868185 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.868895 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.869806 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.870118 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.870194 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.871906 (+ 1712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.871907 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.871908 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.871916 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.873995 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.874346 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.874347 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.874347 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.874407 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.874593 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.874594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.874595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.874720 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.874780 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.875184 (+ 404us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.875255 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260807 20:21:51.875681 834 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:21:51.876104 601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.868352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60836 (local address 127.30.35.254:39271)
0807 20:21:51.868382 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.868384 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.868390 (+ 6us) server_negotiation.cc:407] Connection header received
0807 20:21:51.868429 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.868430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.868438 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.868481 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.868902 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.869587 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.870309 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.870834 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.870951 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.873482 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.873484 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.873484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.873490 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.874977 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.875344 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.875345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.875345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.875407 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.875634 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.875635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.875635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.875774 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.875918 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.875959 (+ 41us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.876026 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 20:21:51.876322 595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af: Bootstrap starting.
I20260807 20:21:51.877000 595 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:51.877324 595 log.cc:824] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:51.878176 595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af: No bootstrap required, opened a new log
I20260807 20:21:51.879884 595 raft_consensus.cc:348] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } }
I20260807 20:21:51.879997 595 raft_consensus.cc:729] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d701f46266fa47bfb01d565b853125af, State: Initialized, Role: FOLLOWER
I20260807 20:21:51.880071 595 consensus_queue.cc:260] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } }
I20260807 20:21:51.880403 595 sys_catalog.cc:564] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:51.880563 843 sys_catalog.cc:455] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } } }
I20260807 20:21:51.880647 843 sys_catalog.cc:458] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [sys.catalog]: This master's current role is: FOLLOWER
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.253@KRBTEST.COM
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.252@KRBTEST.COM for kudu/127.30.35.252@KRBTEST.COM
W20260807 20:21:51.882113 869 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:21:51.882280 869 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:21:51.884761 839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.877682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:38499 (local address 127.0.0.1:54426)
0807 20:21:51.877719 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.877728 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:51.877762 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:51.877865 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:51.877866 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:51.877990 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:51.878012 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.878014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.878848 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.878850 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.879563 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.879566 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.880082 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.880083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.880131 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.880520 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:51.880525 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:51.881831 (+ 1306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:51.883845 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.883846 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.883846 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.884003 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.884179 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.884179 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.884180 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.884228 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.884511 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:51.884512 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:51.884543 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 20:21:51.884594 (+ 51us) client_negotiation.cc:240] Negotiation successful
0807 20:21:51.884678 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260807 20:21:51.884997 840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.877720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54426 (local address 127.30.35.252:38499)
0807 20:21:51.877746 (+ 26us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.877747 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.877754 (+ 7us) server_negotiation.cc:407] Connection header received
0807 20:21:51.877803 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.877803 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.877811 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.877861 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.878079 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.878763 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.879651 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.879993 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.880258 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.881904 (+ 1646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.881906 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.881906 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.881912 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.883772 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.884073 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.884074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.884074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.884124 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.884279 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.884280 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.884280 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.884438 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.884492 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.884859 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.884925 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260807 20:21:51.885286 713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.876628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40566 (local address 127.30.35.253:41399)
0807 20:21:51.876660 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.876662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.876690 (+ 28us) server_negotiation.cc:407] Connection header received
0807 20:21:51.876753 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.876754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.876760 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.876814 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.877343 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.877973 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.878880 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.879093 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.879143 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.882319 (+ 3176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.882320 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.882321 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.882327 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.883992 (+ 1665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.884380 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.884381 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.884381 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.884441 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.884646 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.884647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.884647 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.884769 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.884895 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.885109 (+ 214us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.885184 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260807 20:21:51.886758 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:51.884150 498 master_runner.cc:186] Error getting master registration for 127.30.35.253:41399: OK, instance_id { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" instance_seqno: 1786134111686452 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 20:21:51.886869 498 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 20:21:51.887171 834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5: Bootstrap starting.
I20260807 20:21:51.887703 556 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "d701f46266fa47bfb01d565b853125af"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60836
I20260807 20:21:51.887856 556 raft_consensus.cc:482] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 20:21:51.887873 834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:51.887914 556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:51.888168 834 log.cc:824] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:51.888717 556 raft_consensus.cc:504] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } }
I20260807 20:21:51.888978 556 leader_election.cc:288] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [CANDIDATE]: Term 1 election: Requested vote from peers f87c427ca0cd4803814750e23d0d3ed5 (127.30.35.253:41399), 86ddf991c17244bd87b8c652f8becdb5 (127.30.35.252:38499)
I20260807 20:21:51.889004 834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5: No bootstrap required, opened a new log
I20260807 20:21:51.890755 834 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } }
I20260807 20:21:51.890874 834 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86ddf991c17244bd87b8c652f8becdb5, State: Initialized, Role: FOLLOWER
I20260807 20:21:51.890937 834 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } }
I20260807 20:21:51.891187 834 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:51.891177 882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } } }
I20260807 20:21:51.891418 882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:21:51.891429 781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d701f46266fa47bfb01d565b853125af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "86ddf991c17244bd87b8c652f8becdb5"
I20260807 20:21:51.891752 781 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:51.892961 781 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d701f46266fa47bfb01d565b853125af in term 1.
I20260807 20:21:51.893209 525 leader_election.cc:302] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86ddf991c17244bd87b8c652f8becdb5, d701f46266fa47bfb01d565b853125af; no voters:
I20260807 20:21:51.893339 843 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:51.893491 843 raft_consensus.cc:686] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [term 1 LEADER]: Becoming Leader. State: Replica: d701f46266fa47bfb01d565b853125af, State: Running, Role: LEADER
I20260807 20:21:51.893582 843 consensus_queue.cc:237] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } }
I20260807 20:21:51.894075 843 sys_catalog.cc:455] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [sys.catalog]: SysCatalogTable state changed. Reason: New leader d701f46266fa47bfb01d565b853125af. Latest consensus state: current_term: 1 leader_uuid: "d701f46266fa47bfb01d565b853125af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } } }
I20260807 20:21:51.894184 843 sys_catalog.cc:458] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [sys.catalog]: This master's current role is: LEADER
W20260807 20:21:51.894399 901 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:21:51.894496 901 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:21:51.894663 906 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:51.894881 906 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:51.895802 717 master_runner.cc:186] Error getting master registration for 127.30.35.253:41399: OK, instance_id { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" instance_seqno: 1786134111686452 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 20:21:51.897964 717 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 20:21:51.898522 781 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5 [term 1 FOLLOWER]: Refusing update from remote peer d701f46266fa47bfb01d565b853125af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:51.898855 902 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [LEADER]: Connected to new peer: Peer: permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:51.900143 882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d701f46266fa47bfb01d565b853125af. Latest consensus state: current_term: 1 leader_uuid: "d701f46266fa47bfb01d565b853125af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } } }
I20260807 20:21:51.900271 882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:21:51.910950 840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.890098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54438 (local address 127.30.35.252:38499)
0807 20:21:51.890131 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.890133 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.901833 (+ 11700us) server_negotiation.cc:407] Connection header received
0807 20:21:51.901888 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.901889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.901900 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.901958 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.902798 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.903268 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.904278 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.904619 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.904685 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.906928 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.906930 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.906930 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.906937 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.908728 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.909692 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.909693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.909694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.909761 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.910299 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.910300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.910300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.910440 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.910539 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.910768 (+ 229us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.910853 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 20:21:51.914378 601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.895109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60852 (local address 127.30.35.254:39271)
0807 20:21:51.895191 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.895193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.905816 (+ 10623us) server_negotiation.cc:407] Connection header received
0807 20:21:51.905914 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.905915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.905926 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.905952 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.906590 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.907244 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.908745 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.909056 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.909093 (+ 37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.910682 (+ 1589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.910683 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.910683 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.910691 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.912683 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.913199 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.913200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.913201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.913262 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.913500 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.913501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.913501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.913643 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.913775 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.914201 (+ 426us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.914287 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 20:21:51.916302 713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.895354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40578 (local address 127.30.35.253:41399)
0807 20:21:51.895404 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.895406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.906684 (+ 11278us) server_negotiation.cc:407] Connection header received
0807 20:21:51.906998 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.907000 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.907010 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.907039 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.907655 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.908383 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.909735 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.910036 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.910076 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.913476 (+ 3400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.913477 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.913478 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.913485 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.915074 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.915471 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.915472 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.915472 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.915541 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.915761 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.915762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.915762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.915898 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.915982 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.916143 (+ 161us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.916215 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:21:51.918802 843 sys_catalog.cc:455] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d701f46266fa47bfb01d565b853125af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } } }
I20260807 20:21:51.918902 843 sys_catalog.cc:458] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:51.918972 910 mvcc.cc:205] Tried to move back new op lower bound from 7316005322333913088 to 7316005322317119488. Current Snapshot: MvccSnapshot[applied={T|T < 7316005322333913088}]
I20260807 20:21:51.918942 706 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } attempt: 3
I20260807 20:21:51.919059 882 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d701f46266fa47bfb01d565b853125af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } } }
I20260807 20:21:51.919137 882 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:21:51.919837 906 catalog_manager.cc:1347] Generated new cluster ID: 230af62a6a2f4f419a89d9db707143ca
I20260807 20:21:51.919894 906 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 20:21:51.919898 912 mvcc.cc:205] Tried to move back new op lower bound from 7316005322333913088 to 7316005322317119488. Current Snapshot: MvccSnapshot[applied={T|T < 7316005322333913088}]
Aug 07 20:21:51 dist-test-slave-t7g5 krb5kdc[472](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134111, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.253@KRBTEST.COM for kudu/127.30.35.252@KRBTEST.COM
I20260807 20:21:51.925755 906 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:51.926455 906 catalog_manager.cc:1504] Loading token signing keys...
I20260807 20:21:51.926728 709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.919176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:38499 (local address 127.0.0.1:54448)
0807 20:21:51.919257 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:51.919267 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:51.919307 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:51.919515 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:51.919516 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:51.919664 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:51.919706 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.919709 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.920569 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.920570 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.921372 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:51.921374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.921847 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.921860 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:51.921920 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.922338 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:51.922344 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:51.923796 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:51.925677 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.925678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.925679 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.925886 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.926118 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:51.926119 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:51.926119 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:51.926182 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:51.926431 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:51.926432 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:51.926475 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 20:21:51.926535 (+ 60us) client_negotiation.cc:240] Negotiation successful
0807 20:21:51.926626 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 20:21:51.927022 840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:51.919370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54448 (local address 127.30.35.252:38499)
0807 20:21:51.919403 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.919405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.919411 (+ 6us) server_negotiation.cc:407] Connection header received
0807 20:21:51.919429 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.919430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.919438 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.919477 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.919804 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.920468 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.921449 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:51.921785 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:51.921847 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:51.923871 (+ 2024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:51.923872 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:51.923872 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:51.923880 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:51.925441 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.925980 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.925981 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.925981 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.926057 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:51.926228 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:51.926228 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:51.926229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:51.926364 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:51.926429 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:51.926867 (+ 438us) server_negotiation.cc:299] Negotiation successful
0807 20:21:51.926944 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260807 20:21:51.928498 706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5: Bootstrap starting.
I20260807 20:21:51.929237 706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:51.929562 706 log.cc:824] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:51.938354 906 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af: Generated new TSK 0
I20260807 20:21:51.938558 906 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 20:21:51.939406 706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5: No bootstrap required, opened a new log
I20260807 20:21:51.941363 706 raft_consensus.cc:348] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } }
I20260807 20:21:51.941516 706 raft_consensus.cc:729] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f87c427ca0cd4803814750e23d0d3ed5, State: Initialized, Role: FOLLOWER
I20260807 20:21:51.941603 706 consensus_queue.cc:260] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } }
I20260807 20:21:51.942018 706 sys_catalog.cc:564] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:51.942109 665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:51.943043 665 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5 [term 1 FOLLOWER]: Refusing update from remote peer d701f46266fa47bfb01d565b853125af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:51.943243 666 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d701f46266fa47bfb01d565b853125af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f87c427ca0cd4803814750e23d0d3ed5"
I20260807 20:21:51.941957 926 sys_catalog.cc:455] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } } }
I20260807 20:21:51.943675 926 sys_catalog.cc:458] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:21:51.944495 666 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d701f46266fa47bfb01d565b853125af in term 1.
I20260807 20:21:51.944722 902 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [LEADER]: Connected to new peer: Peer: permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:51.946324 926 sys_catalog.cc:455] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d701f46266fa47bfb01d565b853125af. Latest consensus state: current_term: 1 leader_uuid: "d701f46266fa47bfb01d565b853125af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } } }
I20260807 20:21:51.946476 926 sys_catalog.cc:458] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:21:51.946563 926 sys_catalog.cc:455] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d701f46266fa47bfb01d565b853125af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } } }
I20260807 20:21:51.946666 926 sys_catalog.cc:458] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 20:21:51.949076 941 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:21:51.949131 941 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:21:51.950802 942 mvcc.cc:205] Tried to move back new op lower bound from 7316005322478018560 to 7316005322317119488. Current Snapshot: MvccSnapshot[applied={T|T < 7316005322333913088}]
W20260807 20:21:51.975040 840 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:51.973290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54450 (local address 127.30.35.252:38499)
0807 20:21:51.973337 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.973339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.974337 (+ 998us) server_negotiation.cc:407] Connection header received
0807 20:21:51.974446 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.974447 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.974459 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.974488 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.974965 (+ 477us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54450: BlockingRecv error: recv got EOF from 127.0.0.1:54450 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260807 20:21:51.975965 601 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:51.973742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60860 (local address 127.30.35.254:39271)
0807 20:21:51.973781 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.973783 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.975432 (+ 1649us) server_negotiation.cc:407] Connection header received
0807 20:21:51.975544 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.975545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.975556 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.975583 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.975899 (+ 316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60860: BlockingRecv error: recv got EOF from 127.0.0.1:60860 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 20:21:51.976821 713 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:51.974076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40580 (local address 127.30.35.253:41399)
0807 20:21:51.974111 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.974113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.976291 (+ 2178us) server_negotiation.cc:407] Connection header received
0807 20:21:51.976419 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.976420 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.976431 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.976459 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.976748 (+ 289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40580: BlockingRecv error: recv got EOF from 127.0.0.1:40580 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260807 20:21:51.978952 713 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:51.978231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40586 (local address 127.30.35.253:41399)
0807 20:21:51.978263 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.978265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.978454 (+ 189us) server_negotiation.cc:407] Connection header received
0807 20:21:51.978554 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.978555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.978573 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.978600 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.978906 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40586: BlockingRecv error: recv got EOF from 127.0.0.1:40586 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260807 20:21:51.982165 713 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:51.981353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40596 (local address 127.30.35.253:41399)
0807 20:21:51.981384 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.981386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.981611 (+ 225us) server_negotiation.cc:407] Connection header received
0807 20:21:51.981745 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.981746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.981756 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.981783 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.982119 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40596: BlockingRecv error: recv got EOF from 127.0.0.1:40596 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260807 20:21:51.986174 713 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:51.985378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40604 (local address 127.30.35.253:41399)
0807 20:21:51.985408 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.985409 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.985622 (+ 213us) server_negotiation.cc:407] Connection header received
0807 20:21:51.985736 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.985737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.985747 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.985773 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.986132 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40604: BlockingRecv error: recv got EOF from 127.0.0.1:40604 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260807 20:21:51.992210 713 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:51.991387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40612 (local address 127.30.35.253:41399)
0807 20:21:51.991421 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:51.991423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:51.991649 (+ 226us) server_negotiation.cc:407] Connection header received
0807 20:21:51.991737 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:51.991738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:51.991748 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:51.991777 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:51.992159 (+ 382us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40612: BlockingRecv error: recv got EOF from 127.0.0.1:40612 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260807 20:21:52.002592 713 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:52.001684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40620 (local address 127.30.35.253:41399)
0807 20:21:52.001725 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:52.001727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:52.002009 (+ 282us) server_negotiation.cc:407] Connection header received
0807 20:21:52.002112 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:52.002113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:52.002125 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:52.002155 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:52.002529 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40620: BlockingRecv error: recv got EOF from 127.0.0.1:40620 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260807 20:21:52.021272 713 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:52.020327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40636 (local address 127.30.35.253:41399)
0807 20:21:52.020371 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:52.020373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:52.020653 (+ 280us) server_negotiation.cc:407] Connection header received
0807 20:21:52.020749 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:52.020750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:52.020762 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:52.020790 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:52.021207 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40636: BlockingRecv error: recv got EOF from 127.0.0.1:40636 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 20:21:52.056236 713 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:52.054905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40646 (local address 127.30.35.253:41399)
0807 20:21:52.054951 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:52.054954 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:52.055252 (+ 298us) server_negotiation.cc:407] Connection header received
0807 20:21:52.055563 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:52.055565 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:52.055579 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:52.055610 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:52.056164 (+ 554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40646: BlockingRecv error: recv got EOF from 127.0.0.1:40646 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 20:21:52.122540 713 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:52.121896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40658 (local address 127.30.35.253:41399)
0807 20:21:52.121970 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:52.121972 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:52.121987 (+ 15us) server_negotiation.cc:407] Connection header received
0807 20:21:52.122068 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:52.122069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:52.122081 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:52.122132 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:52.122475 (+ 343us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40658: BlockingRecv error: recv got EOF from 127.0.0.1:40658 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260807 20:21:52.252264 713 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:52.251658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40668 (local address 127.30.35.253:41399)
0807 20:21:52.251724 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:52.251725 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:52.251787 (+ 62us) server_negotiation.cc:407] Connection header received
0807 20:21:52.251839 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:52.251840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:52.251850 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:52.251915 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:52.252208 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40668: BlockingRecv error: recv got EOF from 127.0.0.1:40668 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 20:21:52.370427 902 sys_catalog.cc:455] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d701f46266fa47bfb01d565b853125af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d701f46266fa47bfb01d565b853125af" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 39271 } } peers { permanent_uuid: "f87c427ca0cd4803814750e23d0d3ed5" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 41399 } } peers { permanent_uuid: "86ddf991c17244bd87b8c652f8becdb5" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 38499 } } }
I20260807 20:21:52.370590 902 sys_catalog.cc:458] T 00000000000000000000000000000000 P d701f46266fa47bfb01d565b853125af [sys.catalog]: This master's current role is: LEADER
W20260807 20:21:52.510202 713 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:52.509557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40676 (local address 127.30.35.253:41399)
0807 20:21:52.509623 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:52.509626 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:52.509638 (+ 12us) server_negotiation.cc:407] Connection header received
0807 20:21:52.509732 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:52.509733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:52.509743 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:52.509796 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:52.510141 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40676: BlockingRecv error: recv got EOF from 127.0.0.1:40676 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 20:21:52.894995 901 catalog_manager.cc:1259] Loaded cluster ID: 230af62a6a2f4f419a89d9db707143ca
I20260807 20:21:52.895076 901 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5: loading cluster ID for follower catalog manager: success
I20260807 20:21:52.895869 901 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5: acquiring CA information for follower catalog manager: success
I20260807 20:21:52.896163 901 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 86ddf991c17244bd87b8c652f8becdb5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 20:21:52.949565 941 catalog_manager.cc:1259] Loaded cluster ID: 230af62a6a2f4f419a89d9db707143ca
I20260807 20:21:52.949646 941 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5: loading cluster ID for follower catalog manager: success
I20260807 20:21:52.950531 941 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5: acquiring CA information for follower catalog manager: success
I20260807 20:21:52.950840 941 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f87c427ca0cd4803814750e23d0d3ed5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 20:21:53.026082 1054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:53.023499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40678 (local address 127.30.35.253:41399)
0807 20:21:53.023604 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:53.023605 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:53.023615 (+ 10us) server_negotiation.cc:407] Connection header received
0807 20:21:53.023683 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:53.023684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:53.023737 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:53.023811 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:53.023935 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:53.024461 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:53.025268 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:53.025473 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:53.025524 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:53.025713 (+ 189us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:53.025845 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:53.025916 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:53.025960 (+ 44us) server_negotiation.cc:299] Negotiation successful
0807 20:21:53.025986 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":57,"threads_started":1}
I20260807 20:21:53.030081 1061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:53.027887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54456 (local address 127.30.35.252:38499)
0807 20:21:53.027997 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:53.027998 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:53.028007 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:21:53.028067 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:53.028067 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:53.028104 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:53.028184 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:53.028256 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:53.028765 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:53.029419 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:53.029611 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:53.029698 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:53.029809 (+ 111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:53.029917 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:53.029980 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:53.029995 (+ 15us) server_negotiation.cc:299] Negotiation successful
0807 20:21:53.030012 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":61,"threads_started":1}
I20260807 20:21:53.034730 1054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:53.031939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40688 (local address 127.30.35.253:41399)
0807 20:21:53.031982 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:53.031983 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:53.032011 (+ 28us) server_negotiation.cc:407] Connection header received
0807 20:21:53.032130 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:53.032131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:53.032139 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:53.032165 (+ 26us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:53.032348 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:53.033051 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:53.033962 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:53.034263 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:53.034327 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:53.034479 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:53.034514 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:53.034569 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:53.034628 (+ 59us) server_negotiation.cc:299] Negotiation successful
0807 20:21:53.034649 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260807 20:21:53.034940 1061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:53.031823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54458 (local address 127.30.35.252:38499)
0807 20:21:53.032000 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:53.032002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:53.032010 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:21:53.032033 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:53.032034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:53.032045 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:53.032104 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:53.032212 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:53.032922 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:53.034034 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:53.034306 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:53.034371 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:53.034502 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:53.034530 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:53.034567 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:53.034721 (+ 154us) server_negotiation.cc:299] Negotiation successful
0807 20:21:53.034744 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156}
I20260807 20:21:53.035398 1075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:53.031896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60862 (local address 127.30.35.254:39271)
0807 20:21:53.032041 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:53.032043 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:53.032051 (+ 8us) server_negotiation.cc:407] Connection header received
0807 20:21:53.032096 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:53.032097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:53.032145 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:53.032219 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:53.032376 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:53.032860 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:53.034412 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:53.034694 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:53.034784 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:53.035038 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:53.035153 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:53.035230 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:53.035287 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 20:21:53.035316 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":59,"threads_started":1}
I20260807 20:21:53.037196 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 498
I20260807 20:21:53.060964 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 604
I20260807 20:21:53.070724 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 717
2026-08-07T20:21:53Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2945 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 20:21:53 dist-test-slave-t7g5 krb5kdc[1079](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 20:21:53 dist-test-slave-t7g5 krb5kdc[1079](info): set up 2 sockets
Aug 07 20:21:53 dist-test-slave-t7g5 krb5kdc[1079](info): commencing operation
krb5kdc: starting...
W20260807 20:21:54.208215 30863 mini_kdc.cc:121] Time spent starting KDC: real 1.113s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/test-user.keytab.
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T20:21:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T20:21:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.30.35.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
Entry for principal kudu/127.30.35.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab.
I20260807 20:21:54.328788 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:40443
--webserver_interface=127.30.35.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:45407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:40443,127.30.35.253:38063,127.30.35.252:36759
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 20:21:54.411415 1097 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 20:21:54.411662 1097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:54.411679 1097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:54.411698 1097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:54.412847 1097 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:54.412897 1097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:54.412910 1097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:54.412922 1097 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:54.412932 1097 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:54.414497 1097 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:45407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:40443,127.30.35.253:38063,127.30.35.252:36759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.254.keytab
--principal=kudu/127.30.35.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.254:40443
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.30.35.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:54.414740 1097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:54.414971 1097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:54.419703 1107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:54.419688 1106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:54.419688 1109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:54.419843 1097 server_base.cc:1034] running on GCE node
I20260807 20:21:54.420181 1097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:54.420482 1097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:54.421640 1097 hybrid_clock.cc:648] HybridClock initialized: now 1786134114421619 us; error 35 us; skew 500 ppm
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:54.424116 1097 init.cc:377] Logged in from keytab as kudu/127.30.35.254@KRBTEST.COM (short username kudu)
I20260807 20:21:54.424611 1097 webserver.cc:460] Webserver started at http://127.30.35.254:36783/ using document root <none> and password file <none>
I20260807 20:21:54.424821 1097 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:54.424870 1097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:54.425004 1097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:54.426151 1097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/data/instance:
uuid: "30426f4ba23347f293d20afeab72577a"
format_stamp: "Formatted at 2026-08-07 20:21:54 on dist-test-slave-t7g5"
server_key: "484c79d339837274385abeabd4f8ab77"
server_key_iv: "b3c54883b56f3bd8064296f731c8db02"
server_key_version: "encryptionkey@0"
I20260807 20:21:54.426507 1097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/wal/instance:
uuid: "30426f4ba23347f293d20afeab72577a"
format_stamp: "Formatted at 2026-08-07 20:21:54 on dist-test-slave-t7g5"
server_key: "484c79d339837274385abeabd4f8ab77"
server_key_iv: "b3c54883b56f3bd8064296f731c8db02"
server_key_version: "encryptionkey@0"
I20260807 20:21:54.427834 1097 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:21:54.428545 1120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:54.428714 1097 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:54.428803 1097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/wal
uuid: "30426f4ba23347f293d20afeab72577a"
format_stamp: "Formatted at 2026-08-07 20:21:54 on dist-test-slave-t7g5"
server_key: "484c79d339837274385abeabd4f8ab77"
server_key_iv: "b3c54883b56f3bd8064296f731c8db02"
server_key_version: "encryptionkey@0"
I20260807 20:21:54.428867 1097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:54.450281 1097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:54.452521 1097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:54.452664 1097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:54.456663 1097 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.254:40443
I20260807 20:21:54.456704 1188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.254:40443 every 8 connection(s)
I20260807 20:21:54.457050 1097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/data/info.pb
I20260807 20:21:54.458079 1189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:54.459616 1189 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:21:54.464227 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 1097
I20260807 20:21:54.464342 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-0/wal/instance
I20260807 20:21:54.464524 30863 external_mini_cluster.cc:1428] Setting key 626653f913a9585e12709481fed2815d
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:54.469136 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.460290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40443 (local address 127.0.0.1:42552)
0807 20:21:54.460473 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.460514 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:54.460983 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:54.461222 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:54.461224 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:54.461485 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:54.461646 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.461675 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.462660 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.462661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.463338 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.463339 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.463862 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.463864 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.463933 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.464479 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:54.464489 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:54.466085 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:54.467718 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.467725 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.467727 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.467914 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.468139 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.468139 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.468140 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.468221 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.468566 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:54.468571 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:54.468635 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 20:21:54.468717 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 20:21:54.468958 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":91,"thread_start_us":84,"threads_started":1}
I20260807 20:21:54.469138 1193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.460333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42552 (local address 127.30.35.254:40443)
0807 20:21:54.460509 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.460517 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.460597 (+ 80us) server_negotiation.cc:407] Connection header received
0807 20:21:54.461108 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.461110 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.461126 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.461203 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.461756 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.462586 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.463402 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.463708 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.463818 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.466166 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.466173 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.466173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.466180 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.467636 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.467999 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.468002 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.468002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.468079 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.468278 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.468278 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.468279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.468498 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.468574 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.468762 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.468870 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":83,"threads_started":1}
I20260807 20:21:54.470043 1189 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:21:54.470367 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.470256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:38063 (local address 127.0.0.1:58276)
0807 20:21:54.470301 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.470345 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:38063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260807 20:21:54.470507 1122 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.35.253:38063: connect: Connection refused (error 111)
I20260807 20:21:54.470906 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.470819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:38063 (local address 127.0.0.1:58282)
0807 20:21:54.470857 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.470881 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:38063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260807 20:21:54.471035 1189 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.253:38063: Network error: Client connection negotiation failed: client connection to 127.30.35.253:38063: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.30.35.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.253.keytab.
Entry for principal kudu/127.30.35.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.253.keytab.
I20260807 20:21:54.490404 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.253:38063
--webserver_interface=127.30.35.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.253.keytab
--principal=kudu/127.30.35.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:45407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:40443,127.30.35.253:38063,127.30.35.252:36759
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:21:54.520262 1189 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } attempt: 1
I20260807 20:21:54.520828 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.520685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:38063 (local address 127.0.0.1:58284)
0807 20:21:54.520752 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.520796 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:38063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260807 20:21:54.521204 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.521109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:38063 (local address 127.0.0.1:58292)
0807 20:21:54.521154 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.521182 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:38063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260807 20:21:54.521354 1189 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.253:38063: Network error: Client connection negotiation failed: client connection to 127.30.35.253:38063: connect: Connection refused (error 111)
W20260807 20:21:54.572356 1200 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 20:21:54.572566 1200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:54.572582 1200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:54.572599 1200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 20:21:54.573685 1200 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:54.573719 1200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:54.573730 1200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:54.573752 1200 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 20:21:54.573762 1200 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:54.575181 1200 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:45407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:40443,127.30.35.253:38063,127.30.35.252:36759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.253.keytab
--principal=kudu/127.30.35.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.253:38063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.30.35.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1200
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:54.575371 1200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:54.575558 1200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 20:21:54.580084 1218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:54.580099 1216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:54.580157 1200 server_base.cc:1034] running on GCE node
W20260807 20:21:54.580077 1215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:54.580544 1200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:54.580853 1200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:54.582013 1200 hybrid_clock.cc:648] HybridClock initialized: now 1786134114581993 us; error 31 us; skew 500 ppm
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:54.584422 1200 init.cc:377] Logged in from keytab as kudu/127.30.35.253@KRBTEST.COM (short username kudu)
I20260807 20:21:54.584882 1200 webserver.cc:460] Webserver started at http://127.30.35.253:33171/ using document root <none> and password file <none>
I20260807 20:21:54.585078 1200 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:54.585125 1200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:54.585254 1200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:54.586304 1200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/data/instance:
uuid: "f5585c0ec1d14f8ba5b312df7ad9130d"
format_stamp: "Formatted at 2026-08-07 20:21:54 on dist-test-slave-t7g5"
server_key: "3d970488f0be938ffc1cfbbbcb11e81d"
server_key_iv: "01cc0b7fc6d44d5044c160018fccd6ab"
server_key_version: "encryptionkey@0"
I20260807 20:21:54.586630 1200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/wal/instance:
uuid: "f5585c0ec1d14f8ba5b312df7ad9130d"
format_stamp: "Formatted at 2026-08-07 20:21:54 on dist-test-slave-t7g5"
server_key: "3d970488f0be938ffc1cfbbbcb11e81d"
server_key_iv: "01cc0b7fc6d44d5044c160018fccd6ab"
server_key_version: "encryptionkey@0"
I20260807 20:21:54.587833 1200 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:21:54.588477 1227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:54.588634 1200 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:54.588717 1200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/wal
uuid: "f5585c0ec1d14f8ba5b312df7ad9130d"
format_stamp: "Formatted at 2026-08-07 20:21:54 on dist-test-slave-t7g5"
server_key: "3d970488f0be938ffc1cfbbbcb11e81d"
server_key_iv: "01cc0b7fc6d44d5044c160018fccd6ab"
server_key_version: "encryptionkey@0"
I20260807 20:21:54.588778 1200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:54.589531 1189 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } attempt: 2
I20260807 20:21:54.589933 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.589820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:38063 (local address 127.0.0.1:58300)
0807 20:21:54.589874 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.589903 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:38063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260807 20:21:54.590289 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.590202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:38063 (local address 127.0.0.1:58302)
0807 20:21:54.590246 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.590272 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.253:38063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 20:21:54.590380 1189 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.253:38063: Network error: Client connection negotiation failed: client connection to 127.30.35.253:38063: connect: Connection refused (error 111)
I20260807 20:21:54.597160 1200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:54.598881 1200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:54.598985 1200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:54.602679 1200 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.253:38063
I20260807 20:21:54.602707 1311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.253:38063 every 8 connection(s)
I20260807 20:21:54.603029 1200 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/data/info.pb
I20260807 20:21:54.603938 1312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:54.605511 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 1200
I20260807 20:21:54.605615 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-1/wal/instance
I20260807 20:21:54.605512 1312 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:21:54.605845 30863 external_mini_cluster.cc:1428] Setting key 17bd2ea2da94b9a5d636d191e13bc237
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.253@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.30.35.252@KRBTEST.COM; defaulting to no policy
I20260807 20:21:54.614941 1193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.606355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42564 (local address 127.30.35.254:40443)
0807 20:21:54.606418 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.606420 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.606591 (+ 171us) server_negotiation.cc:407] Connection header received
0807 20:21:54.607054 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.607056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.607068 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.607139 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.607751 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.608455 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.609395 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.609719 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.609804 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.612127 (+ 2323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.612129 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.612130 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.612139 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.613595 (+ 1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.614017 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.614019 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.614019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.614085 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.614296 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.614296 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.614297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.614437 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.614518 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.614797 (+ 279us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.614872 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 20:21:54.615070 1315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.606296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40443 (local address 127.0.0.1:42564)
0807 20:21:54.606465 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.606507 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:54.606963 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:54.607203 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:54.607206 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:54.607466 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:54.607660 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.607664 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.608538 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.608539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.609303 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.609305 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.609824 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.609825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.609928 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.610416 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:54.610426 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:54.612024 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:54.613701 (+ 1677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.613710 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.613712 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.613936 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.614151 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.614152 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.614152 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.614243 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.614521 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:54.614529 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:54.614658 (+ 129us) client_negotiation.cc:769] Sending connection context
0807 20:21:54.614747 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 20:21:54.614882 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":94,"threads_started":1}
I20260807 20:21:54.615695 1312 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.30.35.252@KRBTEST.COM" created.
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.253@KRBTEST.COM for kudu/127.30.35.253@KRBTEST.COM
I20260807 20:21:54.623232 1315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.616010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:38063 (local address 127.0.0.1:58304)
0807 20:21:54.616057 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.616068 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:54.616103 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:54.616359 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:54.616360 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:54.616486 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:54.616543 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.616545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.617460 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.617461 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.618057 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.618059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.618677 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.618678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.618791 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.619224 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:54.619244 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:54.620559 (+ 1315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:54.622253 (+ 1694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.622253 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.622254 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.622414 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.622596 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.622597 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.622597 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.622662 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.622924 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:54.622925 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:54.622964 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 20:21:54.623026 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 20:21:54.623128 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260807 20:21:54.623323 1318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.616046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58304 (local address 127.30.35.253:38063)
0807 20:21:54.616200 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.616204 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.616221 (+ 17us) server_negotiation.cc:407] Connection header received
0807 20:21:54.616240 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.616241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.616267 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.616336 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.616610 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.617357 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.618135 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.618572 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.618649 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.620642 (+ 1993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.620650 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.620651 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.620657 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.622180 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.622484 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.622487 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.622487 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.622539 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.622714 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.622715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.622715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.622859 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.622931 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.623072 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.623201 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
I20260807 20:21:54.623880 1312 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:21:54.624229 1315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.624120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:36759 (local address 127.0.0.1:58266)
0807 20:21:54.624162 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.624206 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260807 20:21:54.624375 1232 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
I20260807 20:21:54.624799 1315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.624715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:36759 (local address 127.0.0.1:58280)
0807 20:21:54.624758 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.624783 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260807 20:21:54.624914 1312 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:36759: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.30.35.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.252.keytab.
Entry for principal kudu/127.30.35.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.252.keytab.
I20260807 20:21:54.636238 30863 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskX5HdRu/build/release/bin/kudu
/tmp/dist-test-taskX5HdRu/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.252:36759
--webserver_interface=127.30.35.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.252.keytab
--principal=kudu/127.30.35.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.30.35.212:45407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.30.35.254:40443,127.30.35.253:38063,127.30.35.252:36759
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 20:21:54.674165 1312 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } attempt: 1
I20260807 20:21:54.674649 1315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.674525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:36759 (local address 127.0.0.1:58290)
0807 20:21:54.674583 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.674617 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 20:21:54.675024 1315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.674932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:36759 (local address 127.0.0.1:58296)
0807 20:21:54.674978 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.675003 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260807 20:21:54.675118 1312 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:36759: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
I20260807 20:21:54.681543 1189 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } attempt: 3
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for kudu/127.30.35.253@KRBTEST.COM
I20260807 20:21:54.688964 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.681859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:38063 (local address 127.0.0.1:58316)
0807 20:21:54.681915 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.681926 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:54.681977 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:54.682139 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:54.682140 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:54.682301 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:54.682371 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.682373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.683313 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.683327 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.683853 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.683855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.684343 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.684343 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.684398 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.684864 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:54.684869 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:54.686265 (+ 1396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:54.688040 (+ 1775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.688041 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.688042 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.688257 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.688460 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.688461 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.688461 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.688512 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.688744 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:54.688745 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:54.688783 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 20:21:54.688827 (+ 44us) client_negotiation.cc:240] Negotiation successful
0807 20:21:54.688898 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260807 20:21:54.689019 1318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.681933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58316 (local address 127.30.35.253:38063)
0807 20:21:54.681991 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.681993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.682028 (+ 35us) server_negotiation.cc:407] Connection header received
0807 20:21:54.682057 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.682058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.682072 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.682129 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.682439 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.683215 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.683934 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.684261 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.684324 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.686360 (+ 2036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.686361 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.686361 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.686369 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.687938 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.688324 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.688325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.688325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.688399 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.688561 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.688561 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.688562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.688688 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.688754 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.688856 (+ 102us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.688936 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260807 20:21:54.689352 1189 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } has no permanent_uuid. Determining permanent_uuid...
I20260807 20:21:54.689683 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.689569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:36759 (local address 127.0.0.1:58308)
0807 20:21:54.689613 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.689638 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260807 20:21:54.689996 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.689912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:36759 (local address 127.0.0.1:58316)
0807 20:21:54.689950 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.689973 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260807 20:21:54.690080 1189 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:36759: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
W20260807 20:21:54.720067 1322 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 20:21:54.720296 1322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 20:21:54.720319 1322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 20:21:54.720345 1322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260807 20:21:54.721227 1189 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } attempt: 1
W20260807 20:21:54.721609 1322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 20:21:54.721678 1322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 20:21:54.721697 1322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 20:21:54.721714 1322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
I20260807 20:21:54.721709 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.721545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:36759 (local address 127.0.0.1:58332)
0807 20:21:54.721601 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.721671 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260807 20:21:54.721735 1322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 20:21:54.722078 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.721964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:36759 (local address 127.0.0.1:58340)
0807 20:21:54.722020 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.722052 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260807 20:21:54.722174 1189 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:36759: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
I20260807 20:21:54.723405 1322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.30.35.212:45407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.30.35.254:40443,127.30.35.253:38063,127.30.35.252:36759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/krb5kdc/kudu_127.30.35.252.keytab
--principal=kudu/127.30.35.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.30.35.252:36759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.30.35.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 07 Aug 2026 18:57:08 UTC on ccycloud.quasar-aagcri.root.comops.site
build id 4573429
I20260807 20:21:54.723634 1322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 20:21:54.723860 1322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 20:21:54.728528 1322 server_base.cc:1034] running on GCE node
W20260807 20:21:54.728492 1332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:54.728493 1335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 20:21:54.728511 1333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 20:21:54.728946 1322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 20:21:54.729255 1322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 20:21:54.730392 1322 hybrid_clock.cc:648] HybridClock initialized: now 1786134114730380 us; error 31 us; skew 500 ppm
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 20:21:54.732817 1322 init.cc:377] Logged in from keytab as kudu/127.30.35.252@KRBTEST.COM (short username kudu)
I20260807 20:21:54.733242 1322 webserver.cc:460] Webserver started at http://127.30.35.252:42853/ using document root <none> and password file <none>
I20260807 20:21:54.733417 1322 fs_manager.cc:359] Metadata directory not provided
I20260807 20:21:54.733454 1322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 20:21:54.733543 1322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 20:21:54.734549 1322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/data/instance:
uuid: "4ee8ea77f8f2470082deef2eb64aec9a"
format_stamp: "Formatted at 2026-08-07 20:21:54 on dist-test-slave-t7g5"
server_key: "cfef27aebe449258d54c6a495bd5da38"
server_key_iv: "c59d00ebcd1da9ef9788f199e302c3a5"
server_key_version: "encryptionkey@0"
I20260807 20:21:54.734838 1322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/wal/instance:
uuid: "4ee8ea77f8f2470082deef2eb64aec9a"
format_stamp: "Formatted at 2026-08-07 20:21:54 on dist-test-slave-t7g5"
server_key: "cfef27aebe449258d54c6a495bd5da38"
server_key_iv: "c59d00ebcd1da9ef9788f199e302c3a5"
server_key_version: "encryptionkey@0"
I20260807 20:21:54.736037 1322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260807 20:21:54.736667 1344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 20:21:54.736876 1322 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260807 20:21:54.736960 1322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/data,/tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/wal
uuid: "4ee8ea77f8f2470082deef2eb64aec9a"
format_stamp: "Formatted at 2026-08-07 20:21:54 on dist-test-slave-t7g5"
server_key: "cfef27aebe449258d54c6a495bd5da38"
server_key_iv: "c59d00ebcd1da9ef9788f199e302c3a5"
server_key_version: "encryptionkey@0"
I20260807 20:21:54.737015 1322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 20:21:54.743254 1312 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } attempt: 2
I20260807 20:21:54.743644 1315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.743519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:36759 (local address 127.0.0.1:58350)
0807 20:21:54.743578 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.743616 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260807 20:21:54.743947 1315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.743873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:36759 (local address 127.0.0.1:58352)
0807 20:21:54.743910 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.743931 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260807 20:21:54.744046 1312 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.30.35.252:36759: Network error: Client connection negotiation failed: client connection to 127.30.35.252:36759: connect: Connection refused (error 111)
I20260807 20:21:54.757098 1322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 20:21:54.759249 1322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 20:21:54.759374 1322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 20:21:54.763391 1322 rpc_server.cc:307] RPC server started. Bound to: 127.30.35.252:36759
I20260807 20:21:54.763451 1425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.35.252:36759 every 8 connection(s)
I20260807 20:21:54.763751 1322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/data/info.pb
I20260807 20:21:54.764657 1426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 20:21:54.766203 1426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.252@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
I20260807 20:21:54.771961 30863 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskX5HdRu/build/release/bin/kudu as pid 1322
I20260807 20:21:54.772060 30863 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskX5HdRu/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786133844183963-30863-0/minicluster-data/master-2/wal/instance
I20260807 20:21:54.772294 30863 external_mini_cluster.cc:1428] Setting key e5c50d84946eb872ff66406371fff012
I20260807 20:21:54.775378 1193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.766920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42570 (local address 127.30.35.254:40443)
0807 20:21:54.766987 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.766989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.767180 (+ 191us) server_negotiation.cc:407] Connection header received
0807 20:21:54.767629 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.767630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.767639 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.767694 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.768358 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.768826 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.769884 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.770068 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.770125 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.772603 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.772605 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.772605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.772614 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.774063 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.774516 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.774517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.774517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.774563 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.774782 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.774782 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.774783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.774879 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.774939 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.775191 (+ 252us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.775271 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 20:21:54.775432 1429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.766870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.254:40443 (local address 127.0.0.1:42570)
0807 20:21:54.767063 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.767105 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:54.767551 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:54.767749 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:54.767753 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:54.767992 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:54.768219 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.768224 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.768927 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.768928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.769782 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.769785 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.770209 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.770210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.770347 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.770894 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:54.770904 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:54.772508 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:54.774136 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.774142 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.774144 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.774448 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.774614 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.774615 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.774615 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.774733 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.774942 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:54.774946 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:54.775066 (+ 120us) client_negotiation.cc:769] Sending connection context
0807 20:21:54.775147 (+ 81us) client_negotiation.cc:240] Negotiation successful
0807 20:21:54.775272 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":99,"threads_started":1}
I20260807 20:21:54.775974 1426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.252@KRBTEST.COM
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.252@KRBTEST.COM for kudu/127.30.35.253@KRBTEST.COM
I20260807 20:21:54.781102 1432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.772654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58366 (local address 127.30.35.252:36759)
0807 20:21:54.772991 (+ 337us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.772996 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.773019 (+ 23us) server_negotiation.cc:407] Connection header received
0807 20:21:54.773039 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.773041 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.773053 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.773121 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.773866 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.774826 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.775746 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.776082 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.776142 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.778365 (+ 2223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.778372 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.778372 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.778377 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.780039 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.780357 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.780360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.780360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.780418 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.780583 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.780583 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.780584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.780722 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.780854 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.780930 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.781004 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":80,"threads_started":1}
I20260807 20:21:54.782423 1429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.776215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.253:38063 (local address 127.0.0.1:58322)
0807 20:21:54.776245 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.776262 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:54.776294 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:54.776473 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:54.776474 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:54.776614 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:54.776671 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.776673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.777290 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.777291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.777872 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.777874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.778265 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.778267 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.778338 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.778678 (+ 340us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:54.778683 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:54.780036 (+ 1353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:54.781448 (+ 1412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.781449 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.781450 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.781638 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.781844 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.781844 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.781883 (+ 39us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.781942 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.782210 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:54.782210 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:54.782242 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 20:21:54.782292 (+ 50us) client_negotiation.cc:240] Negotiation successful
0807 20:21:54.782366 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260807 20:21:54.782503 1318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.776297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58322 (local address 127.30.35.253:38063)
0807 20:21:54.776368 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.776370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.776379 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:21:54.776403 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.776404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.776415 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.776467 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.776772 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.777214 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.777952 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.778190 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.778243 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.780114 (+ 1871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.780115 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.780116 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.780122 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.781379 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.781711 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.781713 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.781713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.781774 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.782001 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.782002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.782002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.782144 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.782216 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.782344 (+ 128us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.782419 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 20:21:54.782912 1426 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.254@KRBTEST.COM
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.252@KRBTEST.COM for kudu/127.30.35.252@KRBTEST.COM
I20260807 20:21:54.789142 1193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.781832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42572 (local address 127.30.35.254:40443)
0807 20:21:54.781871 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.781873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.781939 (+ 66us) server_negotiation.cc:407] Connection header received
0807 20:21:54.781960 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.781961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.781971 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.782023 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.782875 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.783401 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.784348 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.784524 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.784591 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.786765 (+ 2174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.786766 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.786766 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.786773 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.788099 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.788455 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.788456 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.788456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.788506 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.788679 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.788680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.788680 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.788803 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.788944 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.788985 (+ 41us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.789060 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260807 20:21:54.789486 1429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.783127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:36759 (local address 127.0.0.1:58374)
0807 20:21:54.783477 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.783485 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:54.783517 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:54.783661 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:54.783662 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:54.783768 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:54.783794 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.783795 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.784555 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.784556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.785228 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.785230 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.785730 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.785731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.785768 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.786100 (+ 332us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:54.786105 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:54.787063 (+ 958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:54.788533 (+ 1470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.788534 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.788534 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.788715 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.788906 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.788906 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.788907 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.788969 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.789234 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:54.789235 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:54.789269 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 20:21:54.789326 (+ 57us) client_negotiation.cc:240] Negotiation successful
0807 20:21:54.789406 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336}
I20260807 20:21:54.789726 1432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.783188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58374 (local address 127.30.35.252:36759)
0807 20:21:54.783217 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.783219 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.783561 (+ 342us) server_negotiation.cc:407] Connection header received
0807 20:21:54.783583 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.783584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.783596 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.783659 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.783852 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.784482 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.785321 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.785639 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.785730 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.787126 (+ 1396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.787127 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.787128 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.787135 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.788456 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.788789 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.788790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.788790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.788842 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.789033 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.789033 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.789034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.789152 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.789210 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.789469 (+ 259us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.789628 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260807 20:21:54.791183 1426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a: Bootstrap starting.
I20260807 20:21:54.792147 1426 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:54.792470 1426 log.cc:824] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:54.793288 1426 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a: No bootstrap required, opened a new log
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.30.35.253@KRBTEST.COM
I20260807 20:21:54.795169 1426 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } }
I20260807 20:21:54.795341 1426 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ee8ea77f8f2470082deef2eb64aec9a, State: Initialized, Role: FOLLOWER
I20260807 20:21:54.795432 1426 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } }
I20260807 20:21:54.795734 1435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } } }
I20260807 20:21:54.795776 1426 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:54.795831 1435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:21:54.797115 1318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.789844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58328 (local address 127.30.35.253:38063)
0807 20:21:54.789890 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.789892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.789919 (+ 27us) server_negotiation.cc:407] Connection header received
0807 20:21:54.789974 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.789974 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.789983 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.790039 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.790476 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.791126 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.791823 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.792087 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.792172 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.794569 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.794570 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.794570 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.794578 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.796107 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.796414 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.796415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.796415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.796468 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.796637 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.796638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.796638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.796740 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.796889 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.796965 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.797030 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260807 20:21:54.797300 1189 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } attempt: 2
W20260807 20:21:54.797484 1459 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:21:54.798048 1459 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:21:54.799077 30863 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 20:21:54.800117 1155 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "30426f4ba23347f293d20afeab72577a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42572
I20260807 20:21:54.799206 1322 master_runner.cc:186] Error getting master registration for 127.30.35.254:40443: OK, instance_id { permanent_uuid: "30426f4ba23347f293d20afeab72577a" instance_seqno: 1786134114455517 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 20:21:54.801370 1322 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.254@KRBTEST.COM for kudu/127.30.35.252@KRBTEST.COM
I20260807 20:21:54.806427 1432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.797593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58382 (local address 127.30.35.252:36759)
0807 20:21:54.797743 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.797745 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.797751 (+ 6us) server_negotiation.cc:407] Connection header received
0807 20:21:54.797767 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.797768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.797776 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.797818 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.798121 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.798631 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.801444 (+ 2813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.801627 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.801746 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.803804 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.803805 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.803806 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.803812 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.805276 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.805583 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.805584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.805584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.805639 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.805882 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.805882 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.805883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.806041 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.806105 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.806261 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.806338 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260807 20:21:54.806440 1191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.797566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:36759 (local address 127.0.0.1:58382)
0807 20:21:54.797615 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.797624 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:54.797676 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:54.797833 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:54.797834 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:54.797985 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:54.798028 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.798031 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.798704 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.798705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.799400 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.799403 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.801769 (+ 2366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.801771 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.801843 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.802245 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:54.802249 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:54.803724 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:54.805355 (+ 1631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.805356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.805357 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.805518 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.805717 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.805718 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.805719 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.805815 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.806111 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:54.806112 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:54.806160 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 20:21:54.806235 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 20:21:54.806343 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260807 20:21:54.808461 1189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a: Bootstrap starting.
I20260807 20:21:54.809073 1189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:54.809356 1189 log.cc:824] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:54.810194 1189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a: No bootstrap required, opened a new log
I20260807 20:21:54.811177 1189 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } }
I20260807 20:21:54.811293 1189 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30426f4ba23347f293d20afeab72577a, State: Initialized, Role: FOLLOWER
I20260807 20:21:54.811383 1189 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } }
I20260807 20:21:54.811673 1189 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 20:21:54.811632 1462 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } } }
I20260807 20:21:54.811744 1462 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:21:54.811803 1155 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 20:21:54.811870 1155 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:54.812619 1155 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } }
W20260807 20:21:54.813479 1475 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:21:54.813532 1475 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:21:54.813556 1382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "30426f4ba23347f293d20afeab72577a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4ee8ea77f8f2470082deef2eb64aec9a"
I20260807 20:21:54.813727 1382 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:54.814636 1382 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30426f4ba23347f293d20afeab72577a in term 1.
I20260807 20:21:54.814332 1097 master_runner.cc:186] Error getting master registration for 127.30.35.253:38063: OK, instance_id { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" instance_seqno: 1786134114601582 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 20:21:54.816452 1097 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 20:21:54.816668 1124 leader_election.cc:302] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30426f4ba23347f293d20afeab72577a, 4ee8ea77f8f2470082deef2eb64aec9a; no voters:
I20260807 20:21:54.816802 1462 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 20:21:54.816982 1462 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [term 1 LEADER]: Becoming Leader. State: Replica: 30426f4ba23347f293d20afeab72577a, State: Running, Role: LEADER
I20260807 20:21:54.817076 1462 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } }
I20260807 20:21:54.817513 1155 leader_election.cc:288] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [CANDIDATE]: Term 1 election: Requested vote from peers f5585c0ec1d14f8ba5b312df7ad9130d (127.30.35.253:38063), 4ee8ea77f8f2470082deef2eb64aec9a (127.30.35.252:36759)
I20260807 20:21:54.818812 1477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30426f4ba23347f293d20afeab72577a. Latest consensus state: current_term: 1 leader_uuid: "30426f4ba23347f293d20afeab72577a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } } }
I20260807 20:21:54.818929 1477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:54.819171 1488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 20:21:54.819334 1488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 20:21:54.821115 1382 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a [term 1 FOLLOWER]: Refusing update from remote peer 30426f4ba23347f293d20afeab72577a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:54.821588 1477 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:54.822968 1435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30426f4ba23347f293d20afeab72577a. Latest consensus state: current_term: 1 leader_uuid: "30426f4ba23347f293d20afeab72577a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } } }
I20260807 20:21:54.823051 1435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:21:54.829617 1432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.818648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58384 (local address 127.30.35.252:36759)
0807 20:21:54.818683 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.818686 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.820776 (+ 2090us) server_negotiation.cc:407] Connection header received
0807 20:21:54.820890 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.820891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.820902 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.820932 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.821734 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.822441 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.823411 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.823697 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.823737 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.825956 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.825958 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.825958 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.825966 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.827770 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.828495 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.828497 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.828497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.828572 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.828879 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.828881 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.828881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.829027 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.829119 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.829448 (+ 329us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.829526 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260807 20:21:54.832743 1318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.820169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58344 (local address 127.30.35.253:38063)
0807 20:21:54.820210 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.820213 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.824190 (+ 3977us) server_negotiation.cc:407] Connection header received
0807 20:21:54.824288 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.824289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.824302 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.824334 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.825001 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.825715 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.826643 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.827555 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.827602 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.829471 (+ 1869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.829484 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.829484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.829492 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.831373 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.831888 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.831889 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.831889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.831946 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.832142 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.832143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.832143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.832286 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.832405 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.832558 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.832635 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260807 20:21:54.835179 1312 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } attempt: 3
I20260807 20:21:54.835227 1477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "30426f4ba23347f293d20afeab72577a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } } }
I20260807 20:21:54.835340 1477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:54.835902 1435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "30426f4ba23347f293d20afeab72577a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } } }
I20260807 20:21:54.835995 1435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:21:54.836102 1488 catalog_manager.cc:1347] Generated new cluster ID: 52836155b7c943d5beb0f2674bc196eb
I20260807 20:21:54.836145 1488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 07 20:21:54 dist-test-slave-t7g5 krb5kdc[1079](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786134114, etypes {rep=17 tkt=17 ses=17}, kudu/127.30.35.253@KRBTEST.COM for kudu/127.30.35.252@KRBTEST.COM
I20260807 20:21:54.840886 1494 mvcc.cc:205] Tried to move back new op lower bound from 7316005334304391168 to 7316005334291447808. Current Snapshot: MvccSnapshot[applied={T|T < 7316005334304391168}]
I20260807 20:21:54.843035 1315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.835430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.30.35.252:36759 (local address 127.0.0.1:58400)
0807 20:21:54.835540 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0807 20:21:54.835550 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0807 20:21:54.835585 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 20:21:54.835737 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 20:21:54.835738 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 20:21:54.835893 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0807 20:21:54.835936 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.835937 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.836815 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.836817 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.837582 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 20:21:54.837584 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.838106 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.838107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 20:21:54.838176 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.838584 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 20:21:54.838603 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 20:21:54.840084 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 20:21:54.841986 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.841987 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.841987 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.842191 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.842410 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 20:21:54.842411 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 20:21:54.842411 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0807 20:21:54.842477 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 20:21:54.842750 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 20:21:54.842751 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 20:21:54.842804 (+ 53us) client_negotiation.cc:769] Sending connection context
0807 20:21:54.842856 (+ 52us) client_negotiation.cc:240] Negotiation successful
0807 20:21:54.842941 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260807 20:21:54.843657 1432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.835533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58400 (local address 127.30.35.252:36759)
0807 20:21:54.835565 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.835566 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.835575 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:21:54.835651 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.835652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.835662 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.835702 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.836007 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.836724 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.837707 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.837999 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.838046 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.840175 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.840176 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.840177 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.840183 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.841892 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.842267 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.842268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.842269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.842340 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.842541 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.842542 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.842542 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.842669 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.842714 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.843502 (+ 788us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.843574 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260807 20:21:54.845124 1312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d: Bootstrap starting.
I20260807 20:21:54.845880 1312 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d: Neither blocks nor log segments found. Creating new log.
I20260807 20:21:54.846182 1312 log.cc:824] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d: Log is configured to *not* fsync() on all Append() calls
I20260807 20:21:54.847083 1312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d: No bootstrap required, opened a new log
I20260807 20:21:54.848898 1312 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } }
I20260807 20:21:54.849020 1312 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5585c0ec1d14f8ba5b312df7ad9130d, State: Initialized, Role: FOLLOWER
I20260807 20:21:54.849084 1312 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } }
I20260807 20:21:54.849376 1312 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d [sys.catalog]: configured and running, proceeding with master startup.
W20260807 20:21:54.849488 1240 tablet.cc:2369] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 20:21:54.849702 1272 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "30426f4ba23347f293d20afeab72577a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d"
I20260807 20:21:54.849797 1272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d [term 0 FOLLOWER]: Advancing to term 1
I20260807 20:21:54.850600 1272 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30426f4ba23347f293d20afeab72577a in term 1.
I20260807 20:21:54.850804 1269 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d [term 1 FOLLOWER]: Refusing update from remote peer 30426f4ba23347f293d20afeab72577a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 20:21:54.852054 1498 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 20:21:54.853511 1502 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30426f4ba23347f293d20afeab72577a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } } }
I20260807 20:21:54.853678 1502 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:21:54.853777 1502 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30426f4ba23347f293d20afeab72577a. Latest consensus state: current_term: 1 leader_uuid: "30426f4ba23347f293d20afeab72577a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } } }
I20260807 20:21:54.853909 1502 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:21:54.853945 1502 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "30426f4ba23347f293d20afeab72577a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } } }
I20260807 20:21:54.854017 1502 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d [sys.catalog]: This master's current role is: FOLLOWER
I20260807 20:21:54.854712 1193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:54.820512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42576 (local address 127.30.35.254:40443)
0807 20:21:54.820555 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.820557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.825229 (+ 4672us) server_negotiation.cc:407] Connection header received
0807 20:21:54.825334 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.825335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.825345 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.825373 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.826021 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.826742 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.833751 (+ 7009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:54.834063 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:54.834131 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:54.850596 (+ 16465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 20:21:54.850599 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 20:21:54.850599 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 20:21:54.850608 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0807 20:21:54.852760 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.853342 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.853343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.853344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.853409 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 20:21:54.853622 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 20:21:54.853623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 20:21:54.853623 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0807 20:21:54.853878 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 20:21:54.853980 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:54.854186 (+ 206us) server_negotiation.cc:299] Negotiation successful
0807 20:21:54.854628 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260807 20:21:54.857539 1488 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 20:21:54.858294 1488 catalog_manager.cc:1504] Loading token signing keys...
W20260807 20:21:54.858347 1530 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 20:21:54.858403 1530 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 20:21:54.861961 1498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "30426f4ba23347f293d20afeab72577a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30426f4ba23347f293d20afeab72577a" member_type: VOTER last_known_addr { host: "127.30.35.254" port: 40443 } } peers { permanent_uuid: "f5585c0ec1d14f8ba5b312df7ad9130d" member_type: VOTER last_known_addr { host: "127.30.35.253" port: 38063 } } peers { permanent_uuid: "4ee8ea77f8f2470082deef2eb64aec9a" member_type: VOTER last_known_addr { host: "127.30.35.252" port: 36759 } } }
I20260807 20:21:54.862066 1498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a [sys.catalog]: This master's current role is: LEADER
I20260807 20:21:54.862128 1506 mvcc.cc:205] Tried to move back new op lower bound from 7316005334304391168 to 7316005334291447808. Current Snapshot: MvccSnapshot[applied={T|T < 7316005334304391168}]
I20260807 20:21:54.863734 1488 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30426f4ba23347f293d20afeab72577a: Generated new TSK 0
I20260807 20:21:54.863909 1488 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 20:21:54.884199 1432 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:54.882879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58412 (local address 127.30.35.252:36759)
0807 20:21:54.882920 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.882922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.883563 (+ 641us) server_negotiation.cc:407] Connection header received
0807 20:21:54.883664 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.883665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.883676 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.883705 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.884130 (+ 425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58412: BlockingRecv error: recv got EOF from 127.0.0.1:58412 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 20:21:54.885062 1318 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:54.883272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58360 (local address 127.30.35.253:38063)
0807 20:21:54.883308 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.883310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.884591 (+ 1281us) server_negotiation.cc:407] Connection header received
0807 20:21:54.884679 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.884679 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.884689 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.884716 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.885004 (+ 288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58360: BlockingRecv error: recv got EOF from 127.0.0.1:58360 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260807 20:21:54.886200 1193 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:54.885522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42578 (local address 127.30.35.254:40443)
0807 20:21:54.885585 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.885587 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.885734 (+ 147us) server_negotiation.cc:407] Connection header received
0807 20:21:54.885823 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.885824 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.885834 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.885862 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.886142 (+ 280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42578: BlockingRecv error: recv got EOF from 127.0.0.1:42578 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 20:21:54.888404 1318 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:54.887718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58374 (local address 127.30.35.253:38063)
0807 20:21:54.887751 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.887753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.887928 (+ 175us) server_negotiation.cc:407] Connection header received
0807 20:21:54.888020 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.888021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.888037 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.888064 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.888361 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58374: BlockingRecv error: recv got EOF from 127.0.0.1:58374 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260807 20:21:54.891479 1318 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:54.890697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58382 (local address 127.30.35.253:38063)
0807 20:21:54.890729 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.890730 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.890987 (+ 257us) server_negotiation.cc:407] Connection header received
0807 20:21:54.891074 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.891075 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.891084 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.891110 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.891441 (+ 331us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58382: BlockingRecv error: recv got EOF from 127.0.0.1:58382 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260807 20:21:54.895305 1318 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:54.894610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58398 (local address 127.30.35.253:38063)
0807 20:21:54.894642 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.894643 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.894860 (+ 217us) server_negotiation.cc:407] Connection header received
0807 20:21:54.894946 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.894947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.894956 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.894981 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.895264 (+ 283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58398: BlockingRecv error: recv got EOF from 127.0.0.1:58398 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260807 20:21:54.906807 1318 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:54.900590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58412 (local address 127.30.35.253:38063)
0807 20:21:54.900625 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.900627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.900870 (+ 243us) server_negotiation.cc:407] Connection header received
0807 20:21:54.900962 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.900963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.900975 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.901003 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.906726 (+ 5723us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58412: BlockingRecv error: recv got EOF from 127.0.0.1:58412 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260807 20:21:54.917420 1318 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:54.916459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58414 (local address 127.30.35.253:38063)
0807 20:21:54.916514 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.916516 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.916795 (+ 279us) server_negotiation.cc:407] Connection header received
0807 20:21:54.916900 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.916901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.916914 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.916944 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.917329 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58414: BlockingRecv error: recv got EOF from 127.0.0.1:58414 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260807 20:21:54.935923 1318 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:54.934993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58424 (local address 127.30.35.253:38063)
0807 20:21:54.935036 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.935038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.935301 (+ 263us) server_negotiation.cc:407] Connection header received
0807 20:21:54.935418 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.935420 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.935431 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.935475 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.935860 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58424: BlockingRecv error: recv got EOF from 127.0.0.1:58424 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260807 20:21:54.970579 1318 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:54.969519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58432 (local address 127.30.35.253:38063)
0807 20:21:54.969573 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:54.969575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:54.969917 (+ 342us) server_negotiation.cc:407] Connection header received
0807 20:21:54.970030 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:54.970031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:54.970044 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:54.970075 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:54.970517 (+ 442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58432: BlockingRecv error: recv got EOF from 127.0.0.1:58432 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260807 20:21:55.036852 1318 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:55.036133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58438 (local address 127.30.35.253:38063)
0807 20:21:55.036239 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:55.036241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:55.036296 (+ 55us) server_negotiation.cc:407] Connection header received
0807 20:21:55.036353 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:55.036354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:55.036365 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:55.036418 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:55.036783 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58438: BlockingRecv error: recv got EOF from 127.0.0.1:58438 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260807 20:21:55.166826 1318 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:55.166103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58442 (local address 127.30.35.253:38063)
0807 20:21:55.166194 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:55.166196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:55.166254 (+ 58us) server_negotiation.cc:407] Connection header received
0807 20:21:55.166337 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:55.166338 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:55.166352 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:55.166399 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:55.166755 (+ 356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58442: BlockingRecv error: recv got EOF from 127.0.0.1:58442 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260807 20:21:55.424768 1318 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 20:21:55.424143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58452 (local address 127.30.35.253:38063)
0807 20:21:55.424212 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:55.424214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:55.424226 (+ 12us) server_negotiation.cc:407] Connection header received
0807 20:21:55.424276 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:55.424277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:55.424290 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:55.424341 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0807 20:21:55.424700 (+ 359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58452: BlockingRecv error: recv got EOF from 127.0.0.1:58452 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260807 20:21:55.798542 1459 catalog_manager.cc:1259] Loaded cluster ID: 52836155b7c943d5beb0f2674bc196eb
I20260807 20:21:55.798629 1459 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a: loading cluster ID for follower catalog manager: success
I20260807 20:21:55.799401 1459 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a: acquiring CA information for follower catalog manager: success
I20260807 20:21:55.799666 1459 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4ee8ea77f8f2470082deef2eb64aec9a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 20:21:55.858969 1530 catalog_manager.cc:1259] Loaded cluster ID: 52836155b7c943d5beb0f2674bc196eb
I20260807 20:21:55.859068 1530 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d: loading cluster ID for follower catalog manager: success
I20260807 20:21:55.860175 1530 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d: acquiring CA information for follower catalog manager: success
I20260807 20:21:55.860491 1530 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f5585c0ec1d14f8ba5b312df7ad9130d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 20:21:55.940390 1632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:55.937889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58464 (local address 127.30.35.253:38063)
0807 20:21:55.938006 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:55.938007 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:55.938053 (+ 46us) server_negotiation.cc:407] Connection header received
0807 20:21:55.938132 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:55.938133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:55.938186 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:55.938259 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:55.938397 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:55.938901 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:55.939678 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:55.939879 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:55.939922 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:55.940069 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:55.940183 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:55.940241 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:55.940288 (+ 47us) server_negotiation.cc:299] Negotiation successful
0807 20:21:55.940305 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":61,"threads_started":1}
I20260807 20:21:55.944290 1638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:55.942177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58422 (local address 127.30.35.252:36759)
0807 20:21:55.942299 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:55.942300 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:55.942341 (+ 41us) server_negotiation.cc:407] Connection header received
0807 20:21:55.942407 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:55.942408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:55.942442 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:55.942505 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:55.942579 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:55.943039 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:55.943667 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:55.943862 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:55.943909 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:55.944007 (+ 98us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:55.944101 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:55.944151 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:55.944179 (+ 28us) server_negotiation.cc:299] Negotiation successful
0807 20:21:55.944196 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":58,"threads_started":1}
I20260807 20:21:55.948490 1632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:55.945971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58470 (local address 127.30.35.253:38063)
0807 20:21:55.946023 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:55.946025 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:55.946034 (+ 9us) server_negotiation.cc:407] Connection header received
0807 20:21:55.946107 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:55.946108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:55.946118 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:55.946174 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:55.946364 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:55.946843 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:55.947769 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:55.948049 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:55.948112 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:55.948227 (+ 115us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:55.948257 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:55.948299 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:55.948394 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 20:21:55.948421 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260807 20:21:55.948834 1638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:55.946063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58434 (local address 127.30.35.252:36759)
0807 20:21:55.946095 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:55.946096 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:55.946102 (+ 6us) server_negotiation.cc:407] Connection header received
0807 20:21:55.946122 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:55.946123 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:55.946131 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:55.946174 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:55.946375 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:55.947087 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:55.948015 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:55.948273 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:55.948338 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:55.948512 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:55.948541 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:55.948579 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:55.948746 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 20:21:55.948767 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260807 20:21:55.948881 1648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 20:21:55.945830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42592 (local address 127.30.35.254:40443)
0807 20:21:55.945941 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0807 20:21:55.945943 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0807 20:21:55.945977 (+ 34us) server_negotiation.cc:407] Connection header received
0807 20:21:55.946177 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 20:21:55.946178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 20:21:55.946225 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 20:21:55.946293 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 20:21:55.946420 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:55.947183 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:55.947949 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 20:21:55.948241 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 20:21:55.948298 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 20:21:55.948471 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 20:21:55.948573 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 20:21:55.948628 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0807 20:21:55.948775 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 20:21:55.948798 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":58,"threads_started":1}
I20260807 20:21:55.950538 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 1097
I20260807 20:21:55.962037 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 1200
I20260807 20:21:55.971805 30863 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskX5HdRu/build/release/bin/kudu with pid 1322
2026-08-07T20:21:55Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2898 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5844 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (271795 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST